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IDINTlf IERS 

ABSTRACT. /, m 

. This project summary reviews, and extends the findings 
of prior reports made by Abt Assdciates, Inc. (Cambridge, 
Massachusetts) on the, Nutfition Education and Training (NET) program, 
synthesizes evaluation efforts in nutrition education,- and presents a, 
set of conclusions based on the evaluations of nutriticr programs* 
Chapter 1 presents background information on the NET program and 
aives a btief vpverview of the report.. ^Chapter 2 describes the 
organizational framework cf most nutrition programs and relates 
nutrition; education activities to their hypothesized effects* chapter 
3 describes' how/ the NET program is intended to work and hew it has 
been implemented and investigates the implementation cf .programs from 
1978 to 1980. Chapter 3 also reviews the legislative mandate behind 
the national NET program and presents a status report cr the program 
by summarizing findings from surveys of NET state coordinators and a 
sample of local project directors. Models of three state programs are 
presented to show the diversity of responses to the program at the. • 
state level. Chapter U addresses the impact of the NET programs, in 
Georgia and Nebraska, comparing the programs. to othe* Detrition 
education programs a,lso fund*d through the NET -program cr through the 
*ocd and Nutrition Service (Department of Agriculture)* conclusions 
ar6 drawn about the effects of the .programs on childrens* 
nutrition-related knowledge, attitudes, and behaviors. The final" 
chapter sets forth the major conclusions of the report. (FG) 
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AN EVALUATION OF THg NUTRITION 
EDUCATION AND training program 



EXECUTIVE SUMMARY 

1 



The. largest and most recent federal nutrition education effort. was 
approved- by the President in November 1977 when the Nutrition Education and 
Training (NET) program was established with the passage of Public Law 95-166. 
Xfce-NET regulations state that the 1 program is to be implemented through a 
System of grants to' state education agencies to provide for ".••(a) the 
/ nutritiipnal training of educational and food service personnel; (b) the food 
/. service management training of school food service personnel; and (c) the 
conduct of nutrition education activities in schools and child care institu- 
tions." m 

- < * H - ' 

THE PRESENT STUDY /y 

Because of widespread interest in nutrition education at the federal, 
-state, and local levels, the Office ft Policy, Planning and Evaluation within 
the Food, and Nutrition Service (FNS) contracted with Abt Associates Inc. to 
conduct * study of the NET program. The-study reviewed existing nutrition 
education programs and research activities, described program operations 
rfation^lly, and assessed program impact in selected States* This is t .a s umma ry 
of all the- reports produced' during the course of this effort. 

NUTRITION EDUCATION ACTIVITIE^ ~ W . 

The first portion^of the study provides an account of NET as it 
operate* at the state and local project level*. The following conclusions 
were drawn: ' 

• This evaluation was conducted when most NET projects 
were just beginning, to be implemented, and NET has 
made a good >6tart * - Programs are, operating in most 

> % states and NET funda are being distributed and used 
as intended. Some 86 percent of all NET fuhding in 
1978 apd 1979 was* spent on grants for almost 3,000 • 
local projects operating in nearly 17, ,000 schools 
and* reaching more "than 3.4 million .children. Over 
120,000 ^teachers" and 75, 000 .f ood f4 fcervice personnel 
participated in NBT-aponaored workshops. 

\ 

• The greit majority of VET 'State Coordinators "and 
project director* report that they 'are Striving 
toward the goals intended by the enabling legisla- 
tion including, for example,' increasing children's v • 

. acceptance of nutritipus foods; improving teachers 1 
knowledge of the principles and practices jjf nutri-, 
. tio» education; developing and disseminating 
curricula and ether nutrition education materials;' " 
iocreaaingchi'ldtren'S' knowledge of the relationships . 
among fcod, nutrition, *nd health; and increasing 
the use of the school 4 cafeteria t as a Learning- * v " \ » 

♦ , " laix>ratory for nu-trit^oo e<^ucaXion# 



» 



• A; set of diverse state-level NET programs Viave been devel- 
oped and implemented. The study identified three, models' , - 
for delivering NET services^ f rOm the state letfel: (a)- k 
centralized model under which states provide a .uniform ' 
set Of materials and/ or training to multiple local sites; 
(b) a decentralized model where states provide guidance and 
'Asourctfs, but where focal projects have the responsibility 
for deciding exactly what nutrition education activities to 
implement; and (c) $ regional model where services are pro- 
^ vj^ed by multiple resource center*, often located with uni- 
versities. Classroom instruction is included in 85 percent 
of all projects, and 60 percent use of the cafeteria &s a 
learning laboratory, 

• ^ e 'Of course, room for improvement exists. Although most of 
the objectives of the NET legislation are addressed by the 
operating programs, ther* were three areas where, in 1979,* ■ 
NET activities did not appear to be as. fully implemented* or 
as successful as desirable including the training of school 
food service personnel, the development of integrated pro- ■ 
grams, and the dtevelopment, of program monitoring and evalu- 
ation materials; These topics should be* emphasized in the 
future, perhaps through altered program regulations making 7 
' expectation* in these areas clearer, through the dissemina- 
tion of information on programs that Have been successful 
in these areas, and through thfc provision of technical 
assistance in evaluation, 

s 

NUTRITION EDUCATION OUTCOMES * 

The second part of the study focused on the "outcomes'' portion of the 
organizing framework by conducting evaluations of two "potentially successful" 
state-l^vel NET programs, and ,by reviewing the findings from other evaluations 
of programs funded by NET and other FNS sources. The decision to study poten- 
tially successful programs was made in order to see what NET could accomplish 
under the best of circumstances— to give the program a chance to demonstrate 
effectiveness under favorable conditions, if no positive program impacts are 
found under thpse conditions it is safe to say that the program will not be 
successful under less favorable circumstances. On the other hand,' finding 
that a program demonstrates success when well-implemented enables policymakers 
and program practitioners to concentrate on -improving the program, on -insuring 
its faithful implementation, or on disseminating the tested successful 
versions. - 1 ♦ 



The Nebraska Evaluation ' 

' The Nebraska NET program was selected for study because it is nation- 
ally recognized, was recommended by regional and national FNS staff as well as 
other nutrition education professionals, and it has a centralized* approach to 
nutrition education that involves the three major target groups of the NET 
legislation (teachers, food service personnel, and children) in the implemen- 
tation of a curriculum that is t£e same in all participating schools * The 

♦NET projects were in their formative stages when this evaluation war , 
conducted. Project development undertaken since 1979 may veil have 
addressed these problems. » 
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Nebraska program ^lso hafo some preliminary 1 evidence of effectiveness, is being 
adopted in seven other states, and the Nebraska. State. Department 'of Education 
was eager to help plan an# participate in the evaluation, 

• Our* evalua^on of the Nebraska NET program" employed a strong research 
design involving the random assignment of schools to treatment 1 and control 
-group status. Ove* 2,300 children in grades 1-6 distributed across 2.0 schools 
wejre* pretested and posttested .with 'an extensive measurement battery', 
conclusions from this evaluation Were that': r 4 * 

/* • A curriculumroriented centralised' nutrition -education pro- 
gram can have strong positive impact? on children's nutri*- 
tifR-related knowledge across grades 1-6. \ 

9 

• Positive impacts were also found in grades on 1-3 on re- 
ported and ^behavioral measures of food preference, and in 

. ■ grades 4*6 on behavioral measures of willingness to taste 
new foods. , 
'» * 

• ( No strong program- r'el at edT impacts were found on food atti- 

tudes, self-reported ; food habits, or overall plate, waste. 



• The Georgia Eval uation • ' 

. • M 

The Georgia NET program was selected for* study because it was recom- 
mended as particularly well thought through and implemented, and ' because 
Georgia's program follows a ''decentralized'' 1 model of nutrition education that 
contrasts with Nebraska's centralized model and that' is typical of the NET 
models implemented m many of the more populous states. The materials used 
td train program tearhers are comprehensive and could be used in other state*. 
Finally, the Georgia State* Department ofv Education was eager to help plan and 
participate in the evaluation,. * ' 

Our evaluation of ^the' Georgia NET program empl6yed a, relatively weak 
research design involving the nonrandcm* selection of treatment schools that 
were already participating in NET and control schools 1 that w f re not part of 
the program. Some .1,400 children in grades 1 -8' distributed across seven 
-school districts were pretested ^and posttested with * a limited measurement* 
baftery tfrat was designed to detect general impact on nutrition knowledge, 
attitude? and reported habits rather ttfan changes " specific to the Georgia 
procpram. Conclusions* of the .evajwation/wer^e that: . 



A decentralized nutrition education '.^^gram can have a pos- 
itive impact on nut#ition knowledge (at least m grades' 1-£ 
and perhaps in grades 5 and 6)* 

- L ' 

No strong program-related impacts were found on food atti- • 
tudes or self-reported food habit's. ' 



• Th t program, is more effective with youngerXgrades 1 and 2) 
than with older (grades J-6) children.. 




VI i 



Summary of Nutrition Education Evaluations ^ 

» 

' A review of six other evaluations , of nutrition education program^ 
funded by NET and other ^ ENS sources provides evidence corr oboratiivg the 
-conclusions drawn from the Nebraska and Georgia evaluations. First,; it 
appears " relatively easy to produce positive impacts on nutrition knowledge . 
All eight studies ' (Nebraska , Georgia, and six others) report positive findings 
on knowledge* findings that are not only statistically significant, but 
meaningful. ' . j * - 

Impacts on food attitude's and reported •fctod habits are much more dif- 
ficult to produce! Four studies reported some positive results "on attitudes ; 
however, with the exception of one study these varjied by measure and grade. 
, Two studies, did find positive impacts on food-p*late<^attitude# in grades 1 
and 2 suggesting that it may be easier to" alter attitudes for children in the 
early grades. Fbur of the ■ studies included an 1 examination of self-reported 
food habits '', 'but rfone 1 found any strong evidence of program effectiveness in 
this' area* * '* 

» . _ • 

Evidence on food preference vas supplied in only two studies. Conclu- 
sions are mixed because one study found a strong indication of ^positive 
impacts on reported food preference and willingness to select^ new foods while 
the other found no impact. * 

Findings for willingness to taste new foods and plate waste are mixed. 
Of -the five studies that- included some sort of plate 'waste measurement, only 
one found .a positive impact on total consumption. In the Other studies, 
impacts on consumption .varied by grade and food group. One evaluation did 
find' evidence that' NET children* in grades 4-6 were more willing to taste 
previously rejected foods, than their non-NET peers. ^ 

,To sum up, this study has shown that' a variety of NET- and other 
nutrition education programs can increase children'-s nutrition-related 
knowledge. Positive impacts on other outcomes such 4s food-related attitude's, 
habits, preferences, and plate waste were also demonstrated, but <they tended 
to vary-from evaluation to/evaluation and. from, grade* to grade. These findings 
make a good deil of sense considering the shc*rt-term nature of most .nutrition 
education programs. Knowledge is easily <£oriveyed in the ( short term; to expect 
a three-* or ten-week, program to significantly impact behaviors tnat have been 
formed for several years is quite different. * . 
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CHAPTER 1 
INTRODUCTION 



«Tt*e largest *pd most recent federal nutrition educaticjp effort 'was. 
approved by the President in November 1977 when the Nutrition Education and 
Training (NET) program Vas* established with the passage of, Public Law 95-166. 
Because of widespread interest in nutrition education at the federal, state, 
and « local levels, the Office of Policy, Planning and Evaluation (OPPE) within 
the Food and Nutrition Service (PNS) contracted with.Abt Associates Inc; (AAI) 
to, conduct a study of the NET program. To satisfy primarily the needs of the 
nutrition education community, and to_ provide background and context for 
subsequent activities, the study included a review of existing nutrition 
education prograjns and research activities. T£ satisfy primarily the infor- 
mation needs of senior PNS staff and program managers, the evaluation was 
structured to provide a description* pf program operations nationally. 
To satisfy primarily the interests .of Congress, the Office of Management and 
Budget, federal oversight agencies, and advocacy groups , the study included an 

a88e8saen/}f program impact in selected states having projects implemented 

r ^ 1 

sufficiently! to manifest effects 'on students .within the time fname of. the 

I 

evaluat/on. Pinally, to rieet< the needs of all the- above groups,j|th^ study 
called for the preparation of a project summary that integrated findings ftom 
the prior reports. § The reports prepared in these areas under tHi^ contract 
are as follows: ' ^ 
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SUBJECT REPORT 



• Literature Glotzer, J., and Nestor, J. (Eds.} . "Nutrition Education': 
Kavdew * A Review of the Literature, 198CL 



f 

• Program • ,Ferb, T. , Glotzei?, J., Nejitor, J., and Napior , D. The 

Descr ipt ion , Nutrition Education and Training Program: A Status He - 
port, 1977-19*0. \ 
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• Evaluation: St. Pierre, R. , Glotzer, J. , Cook, T.,*and Straw, R./ An 

Evaluation of Nebraska 1 3 ' Experience Nutrition Curriculum * 

% ' St.B«rre, >R. , and Glotzer, J. / An. Evaluation of the Geor- 

gia Nutrition Education and Training Program . 

StwPierre, R. Summary of Measures from the Nebraska and - 
Georgia Nutrition Educatibn and Training Program Evalua- 

* - tions . - 1 

•Project St. Pierre, R. An EvjCLuatioh of the Nutrition Education [ 

Summary . ' • ancl Training Program; Project Summary . % -~ 

This project ' summary reviews and extends the findings of the prior 
reports/ synthesize^ evaluation efforts in nutrition education, and ^presents 
a set of conclusions. Chapter, 2 presents an organizing framework relating 
nutrition education activities to' hypothesized impacts. Chapter 3 describes 
how NET\s intended 'to work and how it has been implemented. Thus, it inves- 
tigates .how NET programs operating between* 19.7SL-80 addressed the "activities" 
portion of our nutritiori education framework,.' It reviews the legisla^fi^e man- 
date behind the national NET* program and presents a status repo^^ on the 
program by summarizing the bindings from a national descriptive ^tudy of NET 
state plans and t needs assessments, and the results from surveys <bf, NET State 
Coordinators antf lo'cal project directors. Finally, it includes descriptions 
of three types of state-leVel NET programs. Chapter 4 addresses the "impacts", 
portion of ' the nutrition education framework by summarizing the results pf 
several NET evaluations £nd comparing them with f irfdings , from evaluations of 
other nutrition education progrj/ms. Finally, Chapter 5 sets forth the major 
conclusions of the Evaluation. 1 * * 





' • , CHAPTER 2 * f 

* AN, ORGANIZING FRAMEWORK FOR NUTRITION 
EDUCATION ACTIVITIES AND IMPACTS 



NUTRITION, EDUCATION E VALUATION : AH ORGANIZING 



EON: Alj 
HYPOTHES 



FRAMEWORK OF ACTIVITIES AND HYPOTHESIZED IMPACTS 

Most nutrition education programs, aim to change children's* nutrition- 
re.lated knowledge, attitudes, ; and behaviors with the long-range goal of im-, 
-proving nutritional and health status. To help set the stage for the descrip- 
tion and evaluations of NET in Chapters Z and 4,. 'an organizing * framework of 
the causal *6hange hoped for irT nutrition educatieta programs is given in Figure 
1. .The framework is in^general agreement with others in. the field (e.g. /Nes- 
tor and Glotaer 1981) and with those focused specifically oh t^e NET progranf- 
^ (e.g., Gillespie 1979). It shows thft a nutrition education program is often 
composed of a .combination of products and processes including, for example, 
training of teachers and food service personnel, use of existing materials- and 
other resources, dej^lopment of new mater ials by classroom teachers, and par- 
^ ent participation. The program almost always' includes an in-c^ais component, 
% aftd often v may involve the cafeteria. Implementation of the program in the 
classroom and cafeteria is hypothesized to ^ impact on children's nutriti'on- 
related attitudes, beliefs, values, knowledge, and dietary habita/behavior . 

Although the developers of different programs hypothesize different relation- 
* • 

ships within this group of variables, the causal* connections are unclear, ad ' 

« > 
shown in the f ramework. Changes in attitudes , knowledge , and -behavior , once. 

they occur, are presumed to lead to improved dietary behavior; then to im- 
proved nutritional status, and finally to improved health status. 



/Nutrition education programs typically identify children as the pri- 
mary target group. Although other constituencies include teachers and, school 
food service personnel who interface /with , children directly and/or modify 
their prfvious practices in preparing *an4 displaying food, the intent is that 
involvement of teachers, food service personnel, par Aits, Qr any other group 
be for the ultimate ^benefit of children. * 



ERLC 



» r 
/ 



12 




. \ Figure 1 

v ' ' 

Organising Framework of Nutrition * 
Program Activities and Outcomes £' 
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Nutrition Education Theories 
' A c h *in.of events shown in Figur.e 1 if such that changes in early 

or - "proximal" outcomes (e.g., delivery and receipt of the classroom curriculum 
packages) will lead to changes in later oc "distal" outcomes (e.g., improved 
\*ilth status). Ia. the absence of at well-articulated theory of how nutrition 
education works, at least two' views of the causal links/ among the outcomes 
identified above appear reasonable, A highly t:ognl^iT theory of the causal 
relationship between education and health status pos tula tes^fchat children 
first need to learn new information that is designed t/f~a?fect their hel 



then thjis information has to affect their beliefs and feelings - about specific' 

nutrition-related behaviors; this new predisposition then has to affect the 

nutritional behaviors in. question. Of these ^ehaviors some — but not all — will 

improve nutritioijal status.. Most educational 'programs -are designed according 

to such a cognitive theory of personal change and* have the immediate goal of 

attec ting knowledge, the more remote goal ot changing feelings/ the even more, 

remote goal of changing- behaviot , and the- yet mote remote goal ,of improving 

nutritional status. I 

I * 

> ' * I < > * 

A second view of the causal relationships shown i*t Figure 1 could be 

" Jg£»** "social environmental. ■ Many Nutrition education programs attempt to 

jHRence t'he child's en^ronme^ in some combi nation of^^ie following princi^- " 

pal ways:- ($) by, training food^ service personnel. who change, the type of food 

provided in school cafeterias or the way food is' served; (b) by having food 

•% ' t * 

service personnel and teachers cooperate to Achieve nutritional ends; and (c) 

by ^developing an outreach Component designed to intl&nce parents. <4he social 

environmental view posits that the consumption behavioAo/ children may Change 

because there are new choices in the school c*feteria\ rath,erthan because of 

Vhat has been l«yned in class. While changes in' th/^envir onment or in 
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behaviors are nqt expected to impact on knowledge directly, such 4&iang< 
/should make the classroom more conducive to learning about nutrition. 

Irrespective of whether the favored* causal theory is cognitive or 
social environmental, £he set of cgncepts that the evaluator should measure is 
basically^ the *ame. Yet, the fact that nutrition- education is grounded, in an 
ambiguous theory, of learning limits th*— ability of any evaluatiorTto account 
for instructional effects. 

■ .L * ' * . • 

Moderator Varia&es 

, . \ 

* The foregoing framework wou}.d be unrealistic if it did not take cogni- 



zance of a host of influences termed Moderator variables" that code t ermine 
process and outcome variables, . Such influences affect 'the sign and m^fnitude 
of any causal impact, and jte Figure 1- we. highlight three such classes of 
influences. The first set of moderator variables might loosely be' called 
"social influences variables." These include family,, peers, the medi*, and 
culture, all of which are presumed to have a powerful effect on knowledge', 
beliefs, attitudes, and behaviors about nutrition. It is, after a>l, usually 
parents who decide the menu of a family, , despite the advice and firm urgings 
of their offspring arf to what should be bought and laid on the table. Any 
program designed^to influence fedBing habits inside or outside of the family 
setting must realize that pwental disapproval of the program's message — 
whether dV#H7 covert* or inadvdflftit — will mediate impact. 

The second class of moderator variables Alates to' the attributes and 
values of the child, whether * these have their origin .in the family or not. 
Some children may' not/' have the ability at n a certain age to j decode^ a ' nutri- 
tional message or tQ see its rejjevarf£e to life;' others may see the relevance 
of eatijig a certain way but just not like the diet preferred by experts. All 
of these factors can codetermine the success of a program. 



A third set <*f moderator variat^les concerns school variables of rele- 

' ' '\ 1 ' ' ' ■ v 

vance to nutritional practices. Variables in this category. include the avail- 
ability and price of snack foods in the cafeteria ihd " elsewhere? the number 
of children eating school lunches and the percentage who receive free or par- 
: tlal^f paid lunches, teachers' support for feeding programs and their belief 
in the value of good nutrition >and nutrition education; the physical design of 
^ the cafeteria/ the number Qf shifts in which eating takes place; the amount of 
\time set aside for' eating during each shift; -whether " tfie 1 eating is done by 

classes, grades, or some other system; the amount of choice offered in the 

** * . « « • * 

» * * 

food provided; and whether the food is cooked on the premises. 

v -P 

spite of the fatrt that our organizing framework hypothesizes that 
^ moderator variables- play * critical role in determining the^ effects of a 
--nutrition education program-, most program^^ve little or no recognition of 
tjieir relationship to the student's overall nutrition environment. ^Further, 
nutrition education Research has rarely assessed the effects of moderator 
variables -on nutrition-related knowledge, ^attitudes, and behaviors. 

FOCUS OF NUTRITION EDUCATION PROGRAMS ^ 

AND IMPLICATIONS FOR EVALUATION / % ' - 

I 

The nature of mos.t nutrition' education programs suggests support of 

the widely h€fld belief that because the United States fe$d supp;y is more than 

adequate * and because most families are able to obtain an 'adequate diet, the' 
- . J . 

determining, factor in dietai^r adequacy is the appropriateness of the choices 

made in selecting foods. Yet, most nutrition education programs have the dual 
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goals (a) of, imparting nutrition knowledge so that program participants/ can 

make "informed" eating ehoiceS about the foods they eat, and (b) developing 

"desirable" e,ating^ behaviprs'. Program developers place differential emphasis 

on thes,e goals, some believing that nutrition education should provide infor- 

mation in order that people can make informed dietary choices and that 

nutrition programs should not interject, values about eating ^ habits because 

that would be invading 'the domain of personal decision making. Others believe 

that the provision of information is not adequate to change dietary behavior 

(witness the number of overweight nutritionists, or .in the health field; the 

number of doctors who smoke), and that the best way to develop desirable 

« *» 

eating behaviors is to encourage them explicitly. 

In spite of this focus on informed choice and desirable eating behav- 
m 

iors, there is no agreed-upon body of nutrition knowledge addressed by nutri- 
tion education, programs; nor is -there .agreement on the key elements of such 
knowledge. Perhaps even more distressing' is that there is little agreement 
about desired behaviors. According to Guthrie (1978) "...we should not cling 
to any Vv 4iethod of [nutrition] education unless we have evidence that it* brings 
about, desirable habits in food consumption" (p. 58). Yet, Contento ( 1 980 ) 
recognizes the lack, of agreement on desired behaviors in pointing out that: 

v .if nutrition* education programs and curricula are going 
to* be increasingly evaluated on the basis of their effects 
on the behavior of children, it must be assumed' that it is 
because we believe that there are indefed dome behaviors 
' vhioh are more desirable than others. Nutrition education 
v cannot avoid, therefore, specifying what these are . . . 

(p. V-74). . • < ^ 

\ s The lack of agreement on desirable nutrition behaviors, attitudes, 

and knowledge is a major facto* contributing to the lack of a strong .theory 

linking these variables. Further, the construction of valid and reliable 
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measurement instruments' is a. most 'difficult task_wh,en there: is bngQihg dis- 
agreement about exactly what the instruments ' should be measuring t Only 
recently hav* a few "standardized" test's./ Qf mjtritipi\ knowledge -appear on" 
the market (e.g., th* Nutritidn Achievement Test by, the National Dariry Council; 
the Nutrition Education Assessment Series by Planning, Development. and Evalua- 
tion Associates). Even these* tests ; do not t h*ve well established measurement 
properties. , * * ; 
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CHAPTER 3 

THE STATUS OF NOT , « . 

This chapter focuses on NET'r apprbach to the nutrition education 
activities and inputs shown in the model presented in the, previous chapter. 

i * 

It, first describes the national NET program, and then reviews findings from a 
natibnally descriptive s unary of NET programs' state plans and needs assess- 
ments as well as from the results of recent surveys of all NET State Coordi- 
nators" and a nation'al sample of ^475 local project directors (Perb et al^ 
1?80) . It provides an account; of NET as it operates at the state aitd* local 
project levels by describing NET target population n^eds, program goals, 
resource allocation, services delivery mechanisms, and program outcomes and 
obstacles. Finally, it contains brief descriptions of selected NET state- 
level programs. 

\ y 
THE NATIONAL NET PROGRAM 

' \ , f 

Legislative Background of the National NET Program 

The Nutrition Education and Training Program (NET) was established in 



1977 via an amendment to the 1966 Child Nutrition Act. The purpose of NET as 
stated in the enabling legislation (Public Law 95-166) is a ..^tb encourage i 
effective dissemination of scientifically valid information to. children 
participating or eligible participate in school lunch and related child 
nutrition 'programs." Such programs are understood to mean multidisciplioiar^ 
programs ".. .by -which scientifically valid 1 information about foods and nutri- 
ents is imparted in a manner th^t individuals receiving such information will 
understand >t he principles o$/nutr i tion* and seek to maximize their well-^eing; 

through food consumption practiifea." - 

* ' * 

11 



Prior *tb 1977, FNS • addressed these needs by funding pilot * projects 
•under the, National School Lunch Act and the Child Nutrition Act. ThesS pilot 
projects, included seminar**, wbrkshops, grantk for nutrition' education .involv-* 
ing schools and communities, . and for the training of fechool food service per- * 
sonnel.* 'A fundamental .difference between NST and previous federal nutrition - 
education efforts is the way that grants were organized and ^dministered.* 
Instead of one-time grants for specific state-level projects that reached 
relatively few children, the NET legislation mandated "...a system of grants 
to State Education Agencies for the development 'of comprehensive nutrition 
information and education programs." % \ 

The natiotfel w£r program is administered By the Program Administration 
Section "of the Nutrition Education Branch, within the Nutrition and Technical 
Services Division of, FNS, with the cooperation of seven regional FNS offices. 
Interim regulations governing- the NET program's administration were issued' 
shortly after the legislative mandate. In May 1979 final regulations were 
published ( Federal Register , Vol. 44, No. 95). ' * The regulations begin by 
stating that the .nutrition information and education effort would be carried 
out by a system of grants to state education agencies to provide for *•••(•) 
the nutritional training of educational and , food service personnel; (b) the 
food service management training of school food service personnel; and (c) the 
conduct of nutrition education activities , in schools and child ca^e institu- 
tions" (p. 28282). Participating states aire required to establish advisory 
councils in order to insure that the advice and recommendations *of -interested 
teachers/ food' seryice personnel, food* ami nutrition professionals and para- 
provisional §, Administrators, cons war groups, parents, and other individuals 



♦A pqbl^eatien by the USDA Nutrition and Technical Services Division 

(1979a) covers projects funded during the peri6d 1910-1*1. 1 

i " * 

— » * 1 * 

t 
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concerned tfibh child nutrition 5 on *i d er*d in program planning, implementa- 
tion, and evaluation. * * — _ ^ 

Finally, the r eg ulatiprts specify t'hafc projects are to be administered 
by state education fcgencie*.*. Each state w^s allocated an amount equal, to"$ .50 
(now $,29) per child enrolled in school* and institutions, butj not less than 
$75,000 to cjpver program, and administrative costs during each fiscal year. 
The total entitlement amounted to approximately $25 million per fiscal year in 
1977-78 and 1978-79, $20 million for fttcai year 1979-80, >and $ IS million for 
1990-81. A proportion* of the total grant was made available to each state 
during the first year of participation in order tp/employ a State Coordinator 

who was to conduct a needs assessment and develop a st^te plan.^ Once the plan 

' is. 
was approved the remaining funds were to be released, ; 

A I - 

Activities and Objectives of the National NET frrt>gram 

( The target* groups for the national NET program and the activities 

\ 

focused at tach g^oup are summarized below (USDA I979fc|%_ \ %s 



\ 



Targe't Group Activity 

Children (early To conduct pilot demons t rat 'ion. projectf 

childhood programs : which may include, but are riot limited 
and grades K-12)~ to, development, dfmonstration , testing', 

' . and evaluation of curricula and classroom 

* * * materials to* instruct- "students with re- 
„ / gard to the nutritional value of food and 
A the relationshio/between food, nutrition, 

and "health . ( ~ 

Pood service person- * To develop, and cdnduct ^training programs 
Tltl /cafeteria per- in the^pr inciples , skill* , and practices 

sortnel of food service management and in the re- 

lationship between ftfod, , nutrition, and 
health. 

/ 1 ' r 

Teachers/early child- To develop and conduct training programs 
hood, elejnentary *nd*^ with respect to providing Vnutrition edu- 
secondary educational cat ioff programs; with respect to the re- 
personnel Lrftionship between fbod, hutrition, and 

health;' and with respect to educational 

* methods and techniques, and issues r«J.at- 

"* ing to nutrition education, ->-»-^ 



Although- NET has spheral target- groups , children are -the ultimate 

• - 

target of the program. The training of other groups is the educational means 

designed to impact upon students' attitudes, knowledge, and behavior regarding 

nutrition and health. NET is* intended to create opportunities for children to 

learn about the importance and application of the principles df good nutrition 

In their daiiy lives. Better understanding of these principles and their 

relationship to health- is expected to increase the probability 'of acceptance 

of the nutritious foods provide through food service operations.- 
» > 
STATE ORGANIZATION AND OPERATIONS ' 

r > i 

NET regulations require states to assess the nutrition education and ■ 

training needs ,of students, teachers, and fo<jd service, personnel. in, ftdi- 
tion, * stafes are required to, prepare annual state plans which .establish 
priorities ior each target group, identify resources set NET goals and 
objectives, 'describe strategies for implementing the program and evaluat- 
ing the attainment of objectives, indicate milestones, establish a state . 

* 9 ? * 

advisory council, and assure compliance with federal requirements for civil 
rights, financial management, and program monitoring. Fund* are* made avail* 
able to. states to have a NET State* Coordinator Vhb is responsible for the/ 
needs assessment and development oi; the ^state' plan. . - ' 

Ferb et al. (J 980) prepared a status report on the NET prograni which 
\ covered the period 1977-80 and which was based on a review of state plans and 
needs assessments as well as a survey of State Coordinators and local project 
directors. At the time the survey was conducted (December 1979) FNS had 

v ■ J ■ N ' 

approved sta£e plans fipm 44 states, the District of Columbia, the Virgin. 
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K Islands, and American Samoa. IA11 but one of the six -states that chose not to 
• r . * 

participate in the program are minimum grant ' states; however, no consistent 

reason was given for why these states chose to -remain' outside the program at 

that time. ; Survey data were analyzed for all 47 states/territories which had 

approved plans. The following sections summarize findings from Ferb et al. 

(1980)*. m % * 



4. 



State-Level Needs Assessments 



/ The NET program was* designed so tha^t states would have- the flexibility 
to determine their own needs and to implement program^ .'to meet those needs. 
To this end, NET regulations call for a needs assessment to be conducted on an 
ongoing basis so that states can determine their nutrition education and 

\ 

training needs* in ^ categories for each year. Needs 'assessment information 
should then be used to formulate annual state plans. Using various sources of 
information and surveys of NET's target groups, State Coordinator^ found 

A 



that: 



• nutrition education materials and curricula for teachers 
were not available widely (reported in 45 states); 

f 

• substantial numbers of teachers lacked training and oppor- 
tunity for training in nutrition education (45 states) ; 

• .substantial numbers of school food service personnel lacked 

important management .and meal production skills and oppor- 
tunity for training in such skills (42 states) ; 

y 

• the coordination* of teachers' and school food service person- 
nel Was hindered by problems of communication and administra- 
tive, support (36 states) and by the fact that food se'rviA 
staff and facilities* were not recognized as a nirtrition edu- 
cation resource (18 states); m \ 

* • 

• students had poor dietary intake (42 states) , many hatf health 

problems including obesity. (3S states) and high incidence of 
dental decay (27 states);^ 

• the food intake of students was adversely affected by income 
constraints (20 states), television (9 states), and parent 

- attitudes and misinformation (11 states);, and 



• skipping meals (20 states) , high rates of plate wast* in the 
school Uunch program (12 states)', , and poor participation in 
the school lunch program (15 states) contributed to the poor 

% diet of students. , 

• The widespread nature of the identified needs confirmed the factors 
which contributed to the" original passage of the NET legislation. Of particu- 
lar interest was the high incidence of reported health problems. These same 
concerns were reported in the "Ten State Nutrition Survey" (Department of 
Health, Education and Welfare 1 972> nearly, a decade ago. ' 

The needs assessment process was considered to be useful by most State 

\ 

Coordinators. However, many noted that time apd resource constraints made it 

V. 

difficult to conduct full needs assessments annually. Though an annual needs 

assessment was not a legal requirement, misinterpretations of the nature and 

, t 

purpose of the needs assessment were common and wfre the source of many infor- 

mal grievances with the needs assessment process. 

V. 

State-Level Resource Allocation 

Data cn state-level planned * expenditures for fiscal years 1978 and 

- > ■ i -J 

1979 were collected via a survey or NET State Coordinators. Estimated coro- 
bined expenditures for these two fiscal years total over $46 million. The 
estimated expenditures per state range from $16 ,000 to over ^4 million. 1 Of 
the total funds approximately five percent were used to pa^ the salaries of 
NET State Coordinators and associated administratis* coqts, one percent for 
trfevel and equipment, two percent for supplies and rentals, and six percent 
for evaluation and needs assessment. The majority of NET funds (86 percent) 

i 

were spent on grants for local projects. 

This apportionment, in general, indicates that NET funds are being 
used as intended. All programs where 60 percent or less of the total project 
funds were \al located to projects were in smaller states with total statewide 
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funding of/$200,000 or less over two years. In these states*, disproport ion- 
ate amounts of money were allocated to administrative costs although the 
actual dollars t spent were* relatively few. The** programs, like the learner 
programs, incurred heavy start-up costs; however, -financial and anecdotal 
reports show that small states simply cannot afford bo meet state and federal 
administrative demands and still have funds left for local projects. 

In addition to financial resources provided by USD£, State Coordina- 
tors, had access to institutional and personnel, resources for nutrition educa- 
tion and training. These non-f irtancir'Sl*, resources included consultation pri- 
marily with* state > 'advi sory councils! colleges and^ universities , "and other 
offices Vithin the. state education agency. f 

A 



State Program Goals *■ - ' 

State Coordinators ' were asked to indicate £he extent to which their 
programs addressed a series of 14 goals. Responses indicated that the major- 
ity of State Coordinators are striving toward tAe > goals intended by the ena- 
bling legislation. The, highest pridtflty gpals indicated by ^t ate Coordina- 
tors were: ' * 

• to change .children 1 s food values and attitudes in order to 
increase their acceptance of nutritious foods (45 states) ; 

• to improve teachers' and administrators* knowledge of the *, 
principles and practices of nutrition education (45 states); 

A 

• t6 develop, promote, disseminate, and/or evaluate curricula 
and other types of educational materials for nutrition educa- 
tion (44 states) ; 

• to increase children's knowledge of the relationships among 
food, nutrition, and health (43 states); and 

• to increase the use of trie schpol cafeteria as a learning 
lStypratory -for nutritional education (42 states). 
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Coordinators 1 responses also' indicated that NET funds are not being used to . 
duplicate the efforts of other similar programs* and that NET has introduced 
basic nutrition education in many areas where virtually none existed before. 

A key area where state programs may be falling short of NET objectives 

x • 
is in the development of "integrated" approaches to nutrition education*** 

' ' 1 v - - % ■ ' . , 

Fourteen states have indicated that, at the present time, . the- development of 
"integrated"' 'approaches to nutrition education ind teanfiS involving teachers, 
food service personnel f ^nd" administrators is not a major goal-. The need for " 
active- and integrated involvement of teachers and food seryic^ personnel, in 
nutrition education was; recognized in the NET legislation and regulations. 
The fact that this goal is not being addressed by a number of state NET prp- 
grains reflects a continuing need for curricula and materials' with, such a 
multidf^ciplirrary focus* 

Obstacles to State Program" Implementation '* • \ 

Three obstacles to program , success were reported by over* half of the, - 
State Coordinators: esyblishing systems of monitoring, feedback, and evalua- 
tion for state and local progr-ams; getting results that others will believe 

' 0 .. 

are evidence of program success; and "red tape" and forms required by state" 

0 i ' 

agencies , and by FNS regional and national .offices. 

> • 

^J5}^ state Coordinators 1 concerns about "red tape" and forms "are to be 

expected. Any program must* include a degree of administrative burden which 

conflicts with the delivery of .services. However, the State Coordinators 

have h&i a substantial reporting burden during the first years 'of NET, being - 

• y ■» *- 

required to conduct needs assessments and prepare three state plans in a 



*An integrated approach is one which involves students, teachers, food 
service personnel, and school administrators, and which combines in-class les- 
sons with' experiential cafeteria-based activities. t 
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period'ot roughly 18imonths, This reporting burden has n& doubt contributed 



to the State Coordinators 1 concerns. 
nenting s n^ogre?s a* 



Documenting^mr ogress a^ the effectiveness of services £s difficult to 
demp^ptrate without effective monitoring and evaluation. State Coordinators 
are handicapped by the lack of training and mejtftbdologies in the field of 
nutrition education. % They also have difficulty in identifying useful £nd 
relevant evaluation tools , in obtaining data and identifying tar get^opu 1 at ion 
needs, and in developing needed materials. 



LOCAL PROJECT ORGANIZATION AND OPERATION ' 

Ah estimated 2,956 local projects have been funded through state NET 
/programs during' 1977-198^). Thes* projects have involved a variety of types of 

V 

organizations and activities with different goals and participants: 

• 35 percent of the projects were located in lical schools;' 

• - 37 percent of projects were based in school districts; 

• 10 percent of th^projects were sponsored by child care 
institutions-; . . 

i 

. • .7 percent were sponsored by colleges and universities; and 

• the remaining projects were housed by regional educational 
j organizations , private non-profit organizations, and sta£e 

agencies other thy the State Education Ageocy. 

% Although schools; school districts, and child care institutions 

account for more than 80 percent of the. projects , they have received just oveY 
50 percent of the total funds. By contrast, colleges and universities account 
for just sewn percent of the projects and have received 26 percent of avail- 
able funds. The distribution of funds ^fleets the NET program's objectives 
not only to provide nutrition education t to students, but also to train teachers 



and* food series personnel and to develop mater ials and curricula. 
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Local Project Goals ^ 

The various organisational hosts have prioritized their project goals 

* 9 

9 ' 

and implemented activities that are responsive to the NET legislative mandate. 

v - * " 

Most NET projects, irrespective of the host organization , place priprityvon 
the sane student-level goals rated highly by State Coordinators. In addition, 
colleges and universities place high priority on a series of goals related to 
the neVls of food service personnel and tetechers. These include: ' 

r I 

e .increasing food service personnel's participation in the 
Nutrition education process (81 percent of colleges and 
universities) ? 

increasing food service personnel's knowledge and appli-^ x 
cation of nutrition principles and nutrition education (80 
m percent) ; and „ • — 

e improving food service personnel skills in mfeal planning 
and preparation (73 percent) • 

NET goals concerned with the development of an integrated educational 

approach through nutrition education teams and increased use of the school 

food service faqility as a learning laboratory for nutation education were 

given high priority in only slightly more than half of the projects. -It is v 

clear that as a standard mode for nutrition education, the integrated approach 

is currently weak because critical, elements of this approach 1 ace being ad- 

dressed**y operating NET programs only moderately. 

Participants In Local Projects 

The NET legislation specifies that the program shall be designed to 
meet the ne^s of teachers, food service personnel, and students at all grade 
levels. The highlights of participation by these ' var ious groups are: 

0 

e More than 3.4 million students or seven percent of the student 
population have* been reached by NET projects. Motf than three 
million elementary children and 100,000 junior high and high 
'school students in nearly 17,000 schools have received class- 
room instruction in nutrition education. 
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Over 11,0m schools have participated in projects that use 
" the cafeteria as a learning laboratory, involving over 2.5 
million students; and nearly one Qillion students have, *~ 
participated in nutrition-related activities outside the 
classrooms or cafeteri*. 

e ,120,0 Op teachers or four percent of the nation's teachers 
participated in NET-sponsored workshops and 75,000 food 
servlc^personnel^15 percent of the nation's total) par- 
ticipated in worKsnops sponsored by NET. 



, Local Project Activities 

Funds for local projects were spent on materials development, teacher 

and food service personnel training, instruction for children., regional nutri- 
tion centers, and^ other graqta and contracts that involved the delivery of 
nutrition education and training. By far, the most extensive activities 
among projects are those serving students. 

e Classroom instruction of students is included i*n 85 percent . 
of all. projects. Sixty percent ot the projects have usedC 
the cafeteria as a learning laboratory, and 51 percent haye 
included some other studei>t-or iented^ activity, such as nutri- 
. tion (airs or gardening projects. 

e Schools and school districts provide the greatest number of N 
^ activities aimed at students, accounting for 82 peroent of 

such activities. * w 

e Colleges and universities piovide the least number of proj- 
ects with only a third including student-oriented activities 
and accounting for only two percent of the projects that 
provide student instruction. 

• MET projects have designed activities targeted toward students with 

r 

Special nutrition education needs or special educational* needs. Among these 
students are pregnant teens, obese children, and mentally retarded students. 

Also included among children with special n.«ds at. minority students who may 

■ / 

have language difficulties oc whose food choices and eating patterns may be 

influenced by culture or ethnicity. 

e Nineteen percent of all projects have conducted activities, 
reaching** total of more than 30,000 obese jituden\s. 
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• Hint percent of the projects sponsored programs for aore than 
11,000 ptegnant teena. 'a 

' • Special nutrition education activitita for eental* retarded 
atudanta hav* bean conducted in 23 par cant of all p?ojecte, 
reaching ovar 18,000 of thaaa atudanta. 

• Thirty parcant of all projecta have included activitiea for 
* aortf than 104,000 minority atudanta. 

Workshops for taachara and food service personnel are intended to 

provide training in the principlee of <*i Id v nutrition and nutrition education, 

procedurea for the uae of the cafeteria aa a learning 'laboratory, sethods of 

clae*rooa inatruction for taachara, and sethods of -imprtwed fobd service for 

cafeteria ataff . , 

e Sixty-pix percent of the projects provided *>rkehope for 
taachara i 5,000 workshops were^held for a total of 120,000 
• teaciiera. The average workshop involved taachara who re- 
ceived, on the average, sore than 16 houra of instruction. 

* e Forty-six percent of the projecta offered wrkshope for food 
aervice personnel, including a total of 75,000 food service 
ataff who received an average of More than 11 houra of in- 
atruction. 

e Local achoola and school diatricta sponsored teacher training 
in roughly two-thirda of their projecta* but only a littl^ 
over a third of school and school district projecta offerOT 
training for school food service personnel. , 

e Oollegea and univeraitiea offered teacher training in only 
**alf of their projecta, but 80 percent df- these ihcluded 
. * training for food sertice personnel. 

Materials ware provided for future use in virtually all workahope tot 

teachers and food aervice personnel, These workshops focused on topica that 

* 

4 • 
are frroad in scope and relate t6 pria^ary MR qbjectivea. A relatively swell 

percentage (59 percent) of teacher workahope included training in uae of the 
cafeteria as a learning laboratory, auggeating that such of the water ial dia- 
tributed doea not include guidance tot integration of claaaroow And cafeteria- 
based nutrition education. I \^ 
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Obstacles tb Local Project Success , v 

Among all projects', t6e obstacles perceived as most problematic are 
"red tape - and forms required by -state agencies (rated as pr^kOeaatic or 
extremely problematic by 36 percent of all project administrators) and "red 
tafre^ and forms required by the FKS regional or national office (32 percent) I 
The next most difficult obstacles relate. to requirements to set up monitoring, 
evaluation, and feedback systems and to c^tain ptfojeafc results that provide 
evidence of progress, both rated as problematic or exto-emeiy problematic by 34 
percent of thf project administrators. These difficulties mirror those- noted 
at^he state le£el. 

STATE- LgVKL NEfr MODELS „ 

As descr ibed above , the nat ional NET pr ogr am prov ides a sys tea of 
gran£s to* states in part for the development of* educational materials and 
curricula. There is no particular model of nutrition education advocated by 
the NET program fpr use on a national baairf. Instead, state education agen- 
cies haye the responsibility for developing state-level programs . 

In the present study we distinguish between three types of models. for 

delivering NET services from tlie* state -levels jal^au centralized model under. 

>which stater provide a uniform set of materials and/or training to multiple 
local sites; (b) a decentralized model where states provide guidance, train- 
ing, resources, and a framework for nutrition education, but where Local 
projects have the responsibility for deciding exactly which nutrition educar 
tion activities to implement; and (c) a regional model where nutrition infor- 
mation and training is provided to local projects by multiple , resource cen- 
ters, often located within universities. To illustradb these three models we 
give brief descriptions of the state-level NET models implemented in Nebraska, 

■ * 

23' * ' r f 



31 



J * 



Georgia, and New York. Many other state programs could have been included, 
and j&i* selection of these only' indicates that they are representative of 
others in a gr/up. 

The Nebraska NET Program 

\ 

The Nebraska NET program is centr ally-administered iji th all partici- 
pating school districts implementing the same $ cur riculum, known as "Experience 
Nutrition^" yhichi consists* of 11 prepared packages of instruction for grades 
K-6. Each package consists of several separate activities, and "steps" for 
the implementation of each- activity ?re specified . In addition, there is 
specif i^ provision for delivery *of the packages to students— each papkage 
includes 12 to 20 class hours of activV^Vin* truction ,and, to varying degrees, 

all involve food service personnel, teachers, and students in one or several 

• * 

activities within packages. * ' 

The program inte^ates nutritioh concepts with basic curricula such^as 

health, social studies, language arts, math, science, art, and music through 

activities such as comparing food costs, writing and acting out skits, tasting 

a wide variety of foods, following recipes, planning menus, and conducting 

scienti fic expe riments . fbod' service personnel are involved in each package, 

and typ packages are designed to be presented to students by food service 

personnel. -Although use of all 11 packages provides systematic and" ccmprehen- 

sive coverage of basic nutrition principles, each package stands on its own. 
* 

and includes its own subject presentation. Packages include all the software 
and most othec items (over 1 ,800 pieces in all) required for conducting the 
activities. This "hands-on" curriculum includes all materials needed for a 
class of 30 students, and materials may be used' year after yey • 
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The Georgia NET Program s 
Georgia's NET program is representative -of many other states partici- A 
pating in NET, in .that its modil of ■ nutrition education is, decentralized. The 
State "Department of Education* considers individual . school u^stems, schools 
v within systems, teachers, and food service personnel -in those schoqls as the. 
key initiators and implementors of nutrition educa^h. The spate's role i* 
to facilitate and support; initiation and Implementation efforts by providing 
^ the conceptual framework for nutrition education, goals and objectives, 
extensive training, resource materials, evaluation, and follow-up. 

The Georgia program is voluntary in the sense that school systems are 
not required, to avail themselves o'f. training opportunities. However, school 
.systems apply for grants on a competitive basis, and once awarded a grant,. 

# • . i 

they are obligated to participate in a five-day nutrition education training 
workshop and a two-day follow-up* Further,, teachers are Expected to return to 
th*ir schools and teach nut^itioij education in their regular classes as well 
as train other teachers to tfeach nutrition education. Thus, each teacher is 
considered to be both, an . individual agent of change through teaching students 

'and a "multiplier" as a result of t/aining oth*t teachers. 

x "I C 1 V ■ 

Subsequent to training, personnel within school* systems are responsi- 



ble for planning, organizing, and* implementing nutrition education projects 
that meet state goals and objectives in ways that are most ffeasible and 
effective in the particular system. In this. way, the Georgia «*3el allows 
nutrition education projects to be tailored to the particulij administrative 
needs 
tdon. 



of the school or school system and to the needs *f the student popula- 
* The sti2e firmly believjts that for NET to be successful in Georgia, 
nutrition education efforts must be designed locally and supported by admini- 



strab^rs, educators t parents, and the community. in this context, the state 

i • • * 

' \ ' • 25 ' 

1 

o 33 



ERIC 



has attempted to .allow M much flexibility as needed while at the sane time 
r * 

providing guidance, technical assistance, and a framework foe nutrition 

\ 

education that is constant across all participating schools* 



The New York NET Program 
t New York's NET program is administered through a series Of 17 regional 
nutrition coordinators located throughout the state. They (1) assess t£e 
nutrition education and training needs of children, food service personnel, 
and teachers in their area, develop instructional and resource materials, and 
then implement programs to meet those needs? (2) work with local and regional 
advisory committees to enhance nutrition education and food service programs 
in schools and other eligible agencies; and (3) •provide technical assistance 
and resources to help schools develop in-service -education progr^as for teach- 
ers and food service personnel, m 

The coocdinaE&ri^ also instruct teachers in use of attrition curri- 
culum for" grades K-9 and the companion teacher's manual. Pinally, the coor- 
dinators plan and implement in-service education\progr ams for food service 
personnel in nutrition knowledge and food service management and encourage 
using the cafeteria as an environment for learning about food and nutrition. 

New York NET program funds have, been used for a variety of other acti- 
vities including the training of regional coordinators; development and eval- 
uation of a pre-K learning package in English and Spanish, and a K-6 resource 
kit to supplement the ptate Nutrition Curriculum Guide; development of public, 
service announcements; completion of ten 30-minute television programs & a 
companion teaching guides and incorporation of nutrition education information 
Into a state-run system that disseminates education-related information and 
research. 

26 ' 
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. Summary- of NET Models 



These brief summaries show that the national NET program has sponsored 



*f tha 



a range of nutrition programs including some that use a structured, curriculun- 
-centered approach developed and administered at the 'state level, others that 
use a decentralized, approach in which states provide guidance and resources, 
but' school systems and individual^ teachers are^esponsjble for developing 
their own programs, and still others that employ a regipnal model. . 1 

Special attention is drawn to 'this diversity in models because the 
evaluations conducted as part" of this study and- a review of other nutrition 
education evaluations suggests strongly that' the different models can each 
pr'oduce positive effects, at. least on tes.ts of nutrition-related 'icnowledge. 
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( . *\ ^ CHAPTER 4 ' ' * 

' - \ 

RESULTSSOF NET AND. OTHER NUTRITION EDUCATION EVALUATIONS 



s 



The preceding chapters introduced the NET program/ described *n 
organizing frakework relating nutrition education activities^ hypothesized 
impacts/ provided an account of NET as it operates at the state ,and local 
levels, and described some sta.te-level NET programs. Given thil broad back- 
ground the present chapter focuses on the "outcomes" portion of the framework 

discussed in Chapter 2 by summarizing the results from evaluations of the 

* 

Nebraska and Georgia NET programs performed as part of the present project, 
and reviewing .the results from evaluations of other nutrition education pro-" 
grams funded By NET or other FNS sources, in order to draw, conclusions about 

X * 

1 

the effects of nutrition education programs on children's nutrition-rela'ted 
knowledge, attitudes, .and behaviors. / 

EVALUATION OF THE NEBRASKA NET PROGRAM * * 

1ST* PIERRE, GLOTZER, COOK, AND STRAW 1981) / 

The Abt Associates Inc. evaluation of NET in Nebraska involved study- 

ing a potentially successful model of nutrition education, in drder to see 

what NET can .accomplish under the* best Qf circumstances. .The decision to' 

limit our evaluation to potentially successful models *wa* Intended Vto maximize 

\i t 
the chances- of detecting positive effects and minimize the chances of "washing , 

out* positive 'effect ML by averaging them' wj.th negative ones. The point is to 

enable the program to demonstrate effectiveness un^er favorable conditions. 

^If no positive- effects are found under these conditions it^^ safe to say that' 

the program^ will not be successful undfcr less favorable circumstances.' On the 

other hand, finding that a program demonstrates success when well-implemented 
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enables- policymakers and program praotitioners to concentrate on iipproving the 
program, on insuring its faithful implementation, or on disseminating the 
tested successful versions. 

The Nebraska iJ&T program was selected for study because it is nation- 
ally recognized, was recommended by regional and national FNS staff as well as 
othfc: nutrition education profess ionals, and it has an approach to nutr/tion 

education that involves the three major target groups of the NET legislation: 
r 

teachers, food service personnel, and chiljjfren. It also had soma preliminary 
evidence of effectiveness, is being adopted ip^seven other states, and the 
Nebraska State Department of Education waa / eagec to help plan and participate 
in the evaluation. Although Nebaska's VET ptaqram operations are funded by 



* 



the curricular portion of Nebraska's iJET program was developed through 

t 

joijit efforts of the Nebraska State Department of Education, experience 
education , an<J the Swanson Center for Nutrition, Inc. , 

Description of the Nebraska .Evaluation 
i The evaluation asses^tdthe Nebraska NET program in terms of how well 
it wa* implemented and the impact it had upon children's knowledge of nutri- 
tion, upon their attitudes and preferences In *he nutrition domain, and upon 
their teported and observed behavioral nutrition habits. The major questions 
addressed .in this evaluation wares (1) To what extent has the Nebraska n£t 
program been implemented in JL% participating schools? (2) What are th^ 
ifciA-term consequences of the Nebraska NET program as it influences nutri- 
^ion-related knowledge, attitudes, pieferences, and habits? (3) What are the 
likely long-term consequences of the Nebraska NET program? 

To achieve these aims, data were collected from over 2,300 children 

* ( 

96 classroom* distributed across grades 1-6 in 20 schools spanning th# 

I . 
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/ state of Nebraska, The '20 participating schools were . randomly selected from 
98 applicants for NET and were randomly assigned to- treatment (13 schools) or 
control f seven schq^B) status with the understanding that control schools 
would be guaranteed participation in NET the following year. In most sampled 
schools all classes participated in the evaluation; however, in some 'instances 
classes were selected ~oi\ly at particular grade levels. All children in any 
selected class were included in the evaluation. 

The evaluation began in mid-year and a battery of measures was given 
to children^ three occasions: the full batter^ was adminiAered to the full 
sample as a pretest in February 1980 and again as. a posttest in May 1980; a, 

{ 

subsample of NET ar*d non-NET children were followed up in December 1980 with 
a subset of the measurement battery. Thus, the ^ge/post time period was ten 
weeks and the pre/follow-up time period was ten months. Mail questionnaires 
were sent to teachers afcd food service managers in May and December 1980 for 
the purpose of estimating the degree to which they implemented the curriculum, 
cause the pre/post data collection had to \% completed in Spring 
. t980, the evaluation was limited to an assessment of the effects of three 
curriculum packages in grades 1-3 and three others in grades 4-6, Teachers 
were asked to "concentrate" delivery of these packaged into the ten-week pre/* 
post ti^ span. Therefore, we conducted two parallel studies ,*and evaluated 
a subset qf the Experience Nutrition curriculum pacica^es (six out of 11) in a 
cross-sectional rather than a longitudinal fashion. 

The measurement battery was' developed by constructing *ome new instru- 
nts, using some that had' been developed in ^Nebraska specifically for. the 
purpose of evaluating '^he Experience Nutrition curriculum, and using "stan- 
dardized" measures of nutrition knowledge* Becfeuse of £ime pressures the 
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measurement bgttery was developed quickly without vigorous pilot-testing 

% 

therefore subjected the pretest data to a* thorough psychometric analysis in 
order to delete poor items and construct reliable scales to use as outcomes 
measures* This process produced measured representing each content domain at 
each grade Level. ' -i 

In addition paper and* pencil measujsW of ^nutrition-related know- 

■ . S 

/ ledge and attitudes, the evaluation includedLfii^BMsessments of food-related 

behavior. In grades 1-3 children were^^Jveyed to determine the frequency 

with which they ^gp. each of several fruits and vegetables. Based on this 

information a decision-making situation was set up in ^which children were 

given a choice in the school lunch line between familiar and unfamiliar fruits 

^ and between familiar and unfamiliar vegetables. The Nebraska program devel- 
opers hypothesized that NET children would be willing to e?cperimea£_2ith new 
foods and would select the unfamiliar fruits and vegetables mpre often than 

, non-NET children. 

A second behavioral assessment, amount of waste of each food item in 
the school lunch, was made in grades 1-6. Because of the expense and logis- 
tical difficulties involved, plate waste data were objected according to 
quasi-experimental design which involved subsampling three NET arid two non-NET 
schools. Two measures of waste were examined: (1) total waste and waste' by • 
food group as percentages of average $erving sizes, and (2) the proportion ^f 
children who ate' none of a given food at pretest but wh<T at least tasted that 
food at posttest. In this area the Nebraska program developers noted that 
while overall waste reduction was not a goal of their program, NET chi^pe* 
should be more willing to try previously rejected foods than their non-NET 
peers. , V 
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Summary of Result^ 

A summary' of the evVluation results is presented here including 
findings about (T) program implementation/ (2) program impact on measures of 
nutrition-related knowledge, attitudes, preferences, and behaviors, and (3) 
the results of a follow-up study . 

The Program Was Implemented " .< 



> 



Teachers, and food service personnel did, in fact, implement the Exper- 
mce Nutrition curriculum packages. The Experience Nutritidn program deve^ 
opers do not specify any particular sequence or timing for* implementation 
preferring that teachers use the curriculum packages> to fit their needs. In 
order to accommodate the evaluation/ delivery of the packages had to be 
"concentrated" into a ten-week span. In 4 spite of this, the average classroom 
teapher implemented close to 80 percent of the , scheduled clas$-leve^ activi- 
ties, and the average school food service director implemented close to 60 
percent of the scheduled school-level activities. Comments supplied by 
classroom teachers suggest that^they may well have, without our knowledge, 

V 

implemented portions of the school-level package* that were, intended to be 
taught by food service personnel, and so the estimates of school-letel imple- 
mentation are likely to b* lower bounds on the real values. Sincfe the curri- 
c^ulum allows teachers flexibility to pick and choose portion^ to * implement, 
the amount of activities covered in the ten-week span allowed a fair test of 
the treatment. 

Students Liked the Program! Teachers 
Felt the Program Achieved its Goals 

Teachers and food service personnel rated the Experience Nutrition 
curriculum packages in terms of student reactions and the degree to which the 

packages achieved their goals. On the whole, there was a strong feeling that L 

• * 

students reacted positively to the curriculum packages and that the packages 

« 

were achieving their objectives. 
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These- findings It ad to- the conclusion that an assessment of program 

^ impact can proceed with confidence Jth at the treatment was implemented . Fur- 

#> * * 
ther, It appears that the Experience Nutrition, materials cyan be used and used 

well by. teachers and food sea vice personnel with a minimum of training. 

v Teacher* report that students lijje the curriculum and that the cqrriculum does 

well at achieving most of its objectives* 

t " • 

The Program Required. a Substantial Effort; 

Involvement of Food Service Personnel WasjKixed 

Theabove findings do not me air that there ye re no problems in imple- 

'mentation or (hat all teachers and food service personnel- found implementation * 

• * • 

to.be%asy. Many teachers complained that the amouq£ time required for 
implementation was far in excess of "what the Experiengp Nutrition materials 
• recommended, and in excess of the time* they Qfjld^ devote. Moreover , *the inte- 
gration of efforts by teachers and school food^service personnel that is envi- 

- - .J* - 

stoned by the Experience"^ Kj^t ion program developers is not accomplished 
'easily. Other examples of problems «with implementation are. that levels of lm- 

. / - * / • . • 

plementation for. the packages to be delivered by food service personnel were, . 

lower than for ptfckfegps to be v delivered by teacfiers, teachers may have re- 
^ placed" food service personnel as instructors in some ca^s, and some food 
^ service personnel comfcv^ed^hat they were not involved as much as they 
< wist&d^* These difficulties all jjpeak to" the issue tfrat imsolvfemeot* of teach- 

er s, food ser vice p ersonnel , and children in a comprehensive nutrition educe* 

tibn program is easier said than dope. I 

% f Impact of the Pfogram * * . ' x 

The Experience Nutrition curriculum had positive effects on children 



K - in sonrf areas and no effects in other*. Table 1 presents a summary of results. 

\ . by content dokain and grade level/' Table 2 presents results at a rotfre clisag-' 
^regated level. In this discussion we speak of the prpgram as having a *posi-" 
tive effect" when treatment group ^children gained significantly more frc| pre* 

rT1 9^ test cto posttest than- control gro^p children, • / 
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Table 1. 

Summary Q f Remits by Content Domain and Grade Level 



Content Domain 



Grades 1-3 



Grades 4*6 



Nutrition Knowledge 




• 




(Curriculum-Specif ic) 




Positive Effects. 


Positive Effects 


(General Knowledge) 




Kb Effects 


Positive Effects 


Food Attitude ' 




No Effects 


No Effects 


^ood Preference 








(Repgrted Preference) 




Posi£±tfe Effects 


Mixed Effects 


(Willingness .to Select New Foods) 


Positive Effects 


N. A. 










Food Habits 








(Reported Habits) * 




No Effects 


No Effects ' * 


. Wllingnes*' to Taste New 


Foods) 


,No 'Effects 


Positive 'Effects 


. (Plate Waste) 




Nc^Efffccts 


No Effects 



- Effects on Knowledge were Positive and Consistent 

Ifie strongest and most positive finding is 'tl^t oi positive treatment 
effects on nutrition knowledge^. These effects are compelling as '* they hold 
across grades and across different metres of knowledge . Further, they are 

stable when either children or classrooms are Used' as the "unit of analysis. 

* * * 

The positive knowledge effects are clearte^t in grades where statistically 

v * • - * 

significant ^effects are exhibited on all seven different knowledge measures 

J I 

(e.g*, recognition of nutrients, knowledge* of the digestive system, relation 
61 energy to calories, knowledge of what- food supplies). Perhaps most impres- 
sive is. the /act % that the knowledge gains produced .on six of the measures 
which were developed specifically to asses* 



^the-Experience 

Nutrition curriculum in grades 4^6 are replicated by substantial gains on a 

"standardized" test (the Nutrition Education Assessment Series) which m was 

"developed to measure a broader spectrum of nutrition knowledge. Clearly, 

"teaching the test" is easier than producing knowledge gains which transfer to 

* t 

a more general, but still 'heavily overlapping, measure of knowledge. * 

In, grades 1*3, positive effects ,#n 'nutrition knowledge exist but 
are not quite as clear as those in grides 4-6- The, major "difference is that 
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Tablo 2 



Contest Do— in 



assults" ' 
Across Grads* 



assults 
By flrajj o 



nutrition Kaowlodgo 



Kaowlodoo of sroakfast Foods 
Kaowlodoo of roods that Grow 

Qndar ground 
Mutrltloa Kaowlodgo (Dairy Council) 



IfA MA^ 0 



Food Mtitaoo / 


Food Attitudes 


0 


0 


0 


0 


~T 

FQQd Ff Of erOOOS 


. Voesjtafelo Preference 
ttlllaeness to Soioet Now Fruits 




'0 
Ha 


MA 


MA 


—4— 


WUliaoaoes to, Soioet Vow VsoetablOs 




Ma 


MA 


MA 


Food aablt# 


"Good" Coasuafrtlon Habits* 


0 


0 


0' 


0 




"lad" Couauaptlon Habits * 
wlllfhgnoaa to Taste Mow roods 


0 

0„ 


0 

Ma 


0 

MA 


0 

MA 


" / 


FUta wests 


0 

\ 


MA 


MA 


MA 


' 1 

/ 

/ 

-J 


rt 

Grades j^d - 











octant Doom in 



fteesure* 



KaWXts** 
Across Grades 



assults 

IT grrti 



/ nutrition Knowledge 



Groat school Nanus 
Mo lotion of Energy to Calorioa 
taergy BalaAca Knowledge 
Digestive Syttssi Kaowlodoo , 
What Mutrionts Ooos Food supply? 
Aeoogaltion of Motrlonts 
Mutritloo Kaowlodoo (MSAS) 



♦ 0 
0 0 

♦ ♦ 

0 > 



Food Afttitudo 



Food Coasuuptioa Atfltudea 
School Lunch Attitudes 
Breakfast Foods Attitude^ 



0 0 ♦ 
0 0 0 
♦ 0 - 



Food Prof ereace 



Fruit Prof oronco 
Vegetable Frof oronco 



Food Habits 



School Loach Habits 0 

"Good" Consuaptlon Habits (AAI) 0 

"lad" Consumption Habits <AA2) 0 

Active Habits ^ 0 

Inactive Habits 0 



"Good", Consumption Habits (MKAJ) 
"Bad" Consumption Habits (MSAS) 
willingness to Taato Mow Poods 
Plata nasto 



a 

♦ o 

• o 
o 
o 
o 

MA MA MA 
MA MA MA 



0" 
0 

<r 
b 
o 
o 

0 



* These seesures woro dorirod via a psych omo t rtV aaalyils of levaral curricula 

' specific aad off-the-ihelf. nutrition education tosts. 

». . 

• + slgnlf los a itatlstleally ilgalf lcaafe offset favoring tho troataoat group. 
- slgalflos a itatlstleally ilgnlfioaat offset favoring tho control group* 

0 signifies a null or non-elgalfLcant off act . t n 
MA oigntf loi that a grada lsval sstiaato could not bo aado 
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in grades 1-3 positive knowledge effects ace found on furriculum-specif ic 
measures (e.g., knowledge of breakfast foods, knowledge of foods . that grow 
underground), but not on the more general measure of nutrition knowledge 
derived frosi the DaJ.ry Council Nutrition Achievement Test which was not 
targeted to the Nebraska curriculum. 

. r 

* In addition tip the finding of statistically significant effects on 
nutrition knowledge, it is important to, note that the effects are large in 
an absolute sense. The adjusted „ treatment/jcontrol group differences on the 
nine^owledge measures which exhibit significant effects range from .23 to 
.82 standard deviations.* ' Thus, the effects on knowledge 'are statistically 
significant and mfaningfuL. There is also evidence that for many knowledge 
v~ ' ■saeures a higher level of implementation is associated with larger effects. 
^ That is, children who'were taught^re, leafned more. ^ 

hlX these results point tp the conclusion that the Experience Nutri- 
tioti; curriculum significantly increased the knowledge of participating chil- 



9 • / * r 

drtn^ The consist ency^of thV results across measures, grades, and units of 

* ' /,/~ ; - . — " T - 

^■ v # analysis; the fact that* the B effects are large in absolute magnitude; the posi- 
- tive relationship on many scales between implementation and size of effect; 

and the fact t^hat effects are larger and more consistent in grades 4-6 than in 

* * * 

4 grades 1-1, when, in fact, tWe curriculum in grader 4-6 ^primarily knowledge 
or^rated, make for an impressive and compel ling^f>nding. — 

. _L ; ., , . ; . . ' 

; Control Children Also ExMbi bg J .Kn ow ledg e Qaifia ; ■ '* — - 



i > * ; Although positive effects of the Nebraska NET program were found on 
measures of nutrition knowledge (treatment children gained significantly more 



Mfhere possible we will augment statements about Statistical signifi- 
cance with information as to the "practical* significance or the "meaningful- 
ness" of an^effect. The measure we us* for this purpose is the standard de- 
viation unit^t and we interpret effects of .25 standard deviations or more as 
» bei,ng meaningful. This is a standard that has gaine£_^soae acceptance in 
judging the size of educational effects. 

* * 
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than control children) , control group children, also showed gains on every 

y I 

knowledge meastrre. This raises the policy question of whether the "competing 
treatment" experienced by the" control* children (defined as whatever they 
Experience through their regular school „ program—the competing treatments 
include "Food. ♦ . Your Choice" and perhaps ot^er nutrition education programs) 

* r 

maty be sufficient for some purposes. Put another way, the control group 
* " * i 

children Sure learning something ejbout nutrition— not as jnuch as the treatment 

chiTdreri, but something. Since the Experience Nutrition curriculum places an 

additional cost on participating schools, the question of cost effectiveness 

Arises. This evaluation does not have information to address this question 

adequately, but it is raised because control students do, in fact, exhibit 

f 

sora^ gains in the absence of the Experience NutritiorTcurriculum. 
No Effects Were Found on Food Attitudes 

The curriculum did not significantly alter attitudes about food in any 

r 

consistent manner. In grades 1*3 no significant effects were found in any 
grade. For grades 4-6 some positive effects were found with respect to atti-~~ 
tudes toward food consumption and attitudes 'toward breakfast; however, these 
were inconsistent and varied by grade. 

Positive Effects Were Found on Food Preferences in 
Grades 1-3; Mixed Effects Were P6und in Grades 4~6 k 

There is Strong evidence of positive effects on food preference in 

grades 1-3. First, t1ie-4&perience Nutrition curriculum influenced children's 

self-reported preference for vegetables. As was the case for knowledge, the 

findings are enhanced by the fact that classrooms where the curriculum package 

dealing with vegetables was best implemented showed n^ore pronounced changes in 

reported preferences. 
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- Second, and more important, positive effects were noted in grades 1-3 
on a Behavioral measu re — increased willingness to 'select unfamiliar vege- " 
tables. That is r when given a ^choice in the school lunch line between an 
unfamiliar and a familiar vegetable , NET children were more likely to select 
.the unfamiliar one than their non^NET counterparts. The evidence for effects 
on preference for fruits is not so consistent, but what there is suggests that 
the program may well have led children to select unfamiliar fruits when 
offered a choice in their school lunch. 

In grades 4-6 the effects on food preferences are mixed. No effects 
are evident with respect to self-reported preference for vegetab^s , and the 
positive results for fruits.* are inconsistent across grades and are not repli- 
cated when clases are use^ as the unit of aaalysis. Behavioral data on food 
selection were not cdllected in grades 4r6 . 

No Effects Were Found an Reported Food Habits 

* 

There simply were no effects on reported food habits either in grades 

1-3 or 4-6. Measures' of "good* and "bad" consumption habits , school lunch 

habits and active and inactive habits all ahowed.no effect. If the program - 

did, in fact, have an impact on reported food habits we are fairly sure it 

would have been detected by at? least one of these measures. 

~ Positive 'Effects W»re Found on Children's Willingness 

to Foods in Grades 4-6 but Not in Grades 1-3; 

- No Effects Were Found On Plate Waste 

« 

Data on changea-^in eating patterns gathered via measurement^ of plate 
waste" support t ne hypothesis' thai Hie N e braska NET progr am h ad a n imp a ct on 
children's willingness tq. sample previously untasted foods. That is r after 
participation in the program llET cftildren^-tffere more willing to taste foods 
that they didn't eat-before the program than were non-NET children. However , 
when the data are broken down by grade it is apparent that the entire treat- 
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ment effect occurs in grades 4-6; there are no NET/non-NET differences in 
^grades 1-3. This is contrary to what we might expect since the Nebraska 
curriculum emphasizes experimenting with foods in grades 1-3 and knowledge 
gains in grades 4-6. 

The data on amount of food consumed indicate that no treatment-related 
change* dccurred either across or within , food groups 4 . There are some pre/post, 
changes in consumption fdr individual foods within individual schools,, but 
these changes are indbnsistent and weak. It is* reasonable to conclude that 
thq Nebraska NET program had no 'effect on the aafcunt of food consumed by par- 
ticipating children during the school lunch period. This does not preclude 
the possibility of changes occurring* in the home or in other food-related 
situations . * * 

Because this part of the evaluation used a quas i-etfper imental design, 
findings regarding food consumption (positive effects 3 in terms of encouraging 
NET children to sample previously rejected foods and no effects on total 
consumption) cannot be given the same weight as the other findings on nutri- 



tion knowledge, attitudes, preferences, and reported food habits. Even so, it 
should be recognized that the results conforA^o the pattern of effects '"hoped 
for by the Nebraska program developers who state (a) that their program 
er^ourages experimentation with different foods . and teaches children to be 
willing to taste unfamiliar food, items, but "(b) fehat they fclace no value on 
the amount of food consumed. We have seen that the effects are at variance 
with expectations, in one respect, because children in grades 1-3 show . no 
change in terms of willingness to taste previously rejected foods while 
children in grades. 4-6 show substantial change., and speculate that' this 
pattern of effects may be 'reflective of a need for the pjovision of nutrition 
knowledge before behavior change can be expected* 
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Knowledge gf frets Persisted but Effects in Other 
Domains Were Hot Evident in a Follow-Up Study 



In order to investigate whether the positive effects on nutrition 
knowledge and 'food preference reported above are .^enhanced, sustained", or 
whether they depay over time, and in order to see whether effects on food 
. attitudes and reported fobd ^habits can be detected over a longer period of 
time,' follow-up data were collected almost a year after pretesting, * As prom- 
ised, treatment and control classrooms were given the option of using Experi- 
ence Nutrition materials during the period between' post testing/ '{May 1980) and 
follow-up testing (December 1980). Very few dlassrocms did so; however, 
many .teachers reported plani to use the curriculum packages in- the .spring. 

The follow-up data reveal that positive knowledge effects were main- V 
tained iji all grades, although • effects were not quite' as strong at the fol- 
low-up as at the posttest. The positive effects on food preferences -t ^a t were 
seen in grades 1-3 were nfct detected at the follow-up, leading us to conclude 
that these effects decayed' when, the program, was withdrawn. Finally, there was 
no evidence oi •delayed - or •sleeper* effects for food attitudes or reported 
food* habits — no effects were found in these ^domains , either in the main eval,ua- 
tion or in the follow-up. * * > * 

: • x ' J 

Conclusions about the Nebraska Evaluation * ,f 
In the faCe of these positive findings about NET in. Nebfllka, two 
issues need to be considered: (1) the degree to which we" believe that the 
Nebraska program rather than some other influence was responsible for the 
results, and (2) the degree "to which the results of this study spy something 

i about the effectiveness oi the Experience Nutrition curriculum outside of 

* * 
Nebraska and the effectiveness of the national NET program. 

/ ' 
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We are quite confident that the treatment, rather/ tfc&A some extraneous 



// 



factor, caused the effects reported here. An examination of plausible rivaft 
hypothese* (e.g. unreliability of measures, treatment diffusion, competing 

• » $ • 

treatments, differential attrition) described in the main evaluation report 
uncovered little t& dispel^ this 'notion. Further^ consideration of whether 
this 'evaluation mi^ht have overestimated or underestimated the true treatment 
effect^ leads us to conclude that our findings may well represent lower 
bounds % IV is* possible that children exposed to more of the Experience 
Nutrition packages f over a longer time/ span , -and measured with improved 
instrumentation, would exhibit larger gains " than those sHown in this * study 

Three other studies yield, additional information on* the effects of the 
Nebraska NET program and allow us to broaden our perspective. First, J4ajure 

* • 

(1980) reported results f rem a • quasi-experimentai evaluation of Nebraska's 

materfsals' in eight statej 



Experience Nutrition 



is ajid metropolitan areas. 



Findings of this study indicated significant positive treatment effects on 

r 

several measures including breakfast variety; breakfast tradition, key nutri- 
ents, food safety, food advertising, and physical fitness. 



/ 



In a second related study, the Swanson Center for Nutrition (1979) 
reported the results of afield test of the Experience Nutrition materials .in 
thr^e Nebraska school districts. The data f rem „many measures show pre/post- 
test gain*, and the report concludes that the program had positive effects on 
children's behavior (selection of foods ndt .previously eaten) and nutrition- 
rel at eds knowledge. No -effects were found on altitudes. It is difficult to 



know whether this interpretation is valid, since the study did not anploy a 
comparison group. 

Finally, Crosby arid Qrossbart (1980) mailed questionnaires to the 
parents of children .who participated in St. Pierre et al.'s (1981) evaluation 
of the Experience Nutrition program. Parent^reported positive program 
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affects such as NET children ^ being more likely than. their non-NET counterparts ^ ] 

t *o know about nutrition and about different foods, to ask for meal items and 
snacks learned about in school, and to believe that a balanced diet' is impor- 
tant. Parents ^al«o reported considerable pareH/chil'£ interaction over the 
program. The study is flawed by a rather low 44 percent response rate which 
could well have biased the results in favor of NET. 

To -sum up, these three studies find generall^ positive effects of the 
^ Experience Nutrition curriculum. Though the methodological flaws of the 
-\studies would render them unconvincing if taken alooe, they corroborate the 
findings and increase our confidence in the present evaluation. 

This ^evaluation should therefore be regarded as showing that NET can 
work; that we 11 -developed, centrally administered, curriculum-oriented 
nutrition education program can haye positive effects on children's knowledge 
^ . and behavior i However, it cannot tell r us whether the Experience Nutrition 

curriculum will' work as well in other locations, nor cam it tell us' about the ^ 
. success of other NET models. 



w * EVALUATION OF THE GEORGIA NET PROGRAM 
(ST. PIXRRE AND GLOTZER i1981 ) 

: : ; — ' 

• A second evaluation conducted as part of the Abt Associates Inc. NET 
study assessed the impact of the Georgia NET program. As was the case in the' 
.Nebraska evaluation, Georgia had a reputedly exemplary program.. Selected for 
study because it was recommended as particularly well thought through and 
'implemented, Georgia's program provides ah important contrast with Nebraska 1 1 
*,in that it fbildws a "decentXAHzed" mo aal of nutrition education typical of 
that in many of the more populous states. The materials used to train program 
teachers ^ere comprehensive and could be used in other states. Finally, the 
Georgia State Department, of Education was eager to "help plan and participate 
in the evaluation. 
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Because of problems in implementing the evaluation design, conclusions 
reached about the effectiveness of the Georgia NET program will be tentative. 
Ibis study say underestimat^ the effects of the Georgia program, and the in-. 
fdrmation\ contained here should bemused as background and input to future 
evaluations of the Georgia program rather than as providing conclusive evi- 
dence on program effectiveness. ^ 

Description of the Evaluation 

The evaluation focused on an assessment "of m the Georgia NET prograxl^in 
terms of th^ results it had upon children's knowledge of nutrition, upon their 
attitudes in the nutrition domain, and upoft their reported nutrition hflbita . 
Further, the evaluation asseMio the degree to which the measurement battery 
was relevant to ' the nutrition education activities taught in participating 
cla*sroc«§. To achieve these aims within the restr iction^j|ed by Georgia's 
existing commitments to school districts already participating in NET, a 
quasi-experimental evaluation was designed, and dlte were collected from a 
pucposively selected sample of over. 1 ,400 dfiildren in 52 clasSfrooms distri- 
buted across grades 1-8 in seven school systems spanning the state of Georgia. 
Over 700 children whose teachers participated in the NET training program 
formed the treatment group while moi;e than 600 children who had teachers who 
did not take part in the NET training seasiori* served as the comparison 

l 

group. > 

The sample was drawn putpo^ively -in several stages, relying on the 
recosnendations of the.NET State Coordinator, in order to maximize the repre- 
sent at ion of •exemplary" school systems, schools, and classrooms. In spite of 
everyone's best efforts some school systems, schools, and classes dropped out 
or declined to participate and'thu? the final sample is characterized by a 
degree of self -selection. ^ *« - 
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The prog ran was scheduled to run for the 1979*80 school year. Teacher 
training was conducted during the summer of 1979, and program operations were 
scheduled to begin at the start of the school year. However, this evaluation 
contract was not awarded until June 1979 , and AAI, FNS, and Georgia did not 
agree on the inclusion of Georgia as an exemplary state for evaluation uritil 
October 1979. At that point no appropriate measurement battery existed and 
a battery of child-level instruments was developed and administered as a "pre* 
test" in early December 1979. A somewhat: reduced 14 battery was administered as 
a posttest in early Nay 1980. A mail questionnaire was sent to all parti- 
cipating teachers and food service managers in May 1980 for the purpose of 
documenting teacher background , to assess the overlap between the test items 
and the program as implemented , and to obtain information on the amount of 
nutrition education activities covered prior to the pretest. 



Summary of Results 

A summary of the evaluation results is presented here including 
findings about (D^^rogram* implementation, and (2) program impact on measures 



of nutrition-related knowledge, attitudes, and reported habits. 

A Variety of Nutrition Education Activities were Conducted 

During the 1979-80 school year site visits were conducted by the 

Georgia State Department of Education for the purpose of observing and docu- 

menting NET activities in classrooms. Reports from these visits do not offer 

r 

implemented Jin Georgia, but they do show 



a systematic description of 



f NM_aa- 
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clearly the variety of nutrition education activities that were implemented in 
participating classrooms .and reflect thf -operation of the decentralized model. 

While most schools were in some way involved with activities to pro- 
mote nutritious eating habits, the activities varied and often served multiple 
purposes • . In ,one school the food service prepared and served "country 
breakfast" to students and parents. In addition to promoting a nutri 

r 

breakfast, this sewed to involve parents in nutrition education. in many 
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claeeroojs^ntt^rition education waa integrated with arithmttic by planning 
leeeona around food coata aril food budgeting. Many laaaon plana vara deeigne4 
to temch atudanta to caad and evaluata^food labala and to learn* about adver- 
tising tachniquaa that may ba misleading. Audiovisual materiale were used 
exteneively and in one achool atudanta wrota and pcoducad thaic own nutrition 
"spots." ' 

As reported, the moat auccaaaful nutrition education projacta wara 
thoaa that involved achool adminietratora and paranta who halpad %£th idaaa 
and organisation. Laaa auccaaaful projacta were c a potted "in schools with 
littla or no adminietrative support or where thara was misunderstanding about 
who waa ultimately responsible for nutrition education curricula. In theae 
achoolrs whara thara waa no clear direction or director, nutrition projects 
simply had difficulty getting off the ground. 

' The array of activitiea, ^ich vary in type aa well aa quality, ahow y 
that where Georgia NET project administrators are motivated, the program 
process operatea well — atudanta, achool peraonnel, arid parents describe 
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nutrition education" experienced with enthuaiaam. WfierflT Variety of factors" 
may impede motivation to implement nutrition education, the proce^e vorks less 
wall. .It i* difficult then to make conclusive remarka abopt the "workability" 
of tha Gaorgia decentralized model. In some systems, there seems to be a need 
for mora structure and guidance from a central base. Other 1 systems seem to 
thrive on their freedom to be creative. 

It is" clear from reviewi n g t h e fiald reports of the State Department 
of Education that the Georgia'NET progra^ can be k character i zed accurately aa 
•decentraliked." Teachera, achooia, \fnd achool ayatems do work within the 
broad goala aet by the atate, yet their programs are diverse and eelf-gener- 
at«d. 
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The Test Battery was Relevant to' the Program Content 

Schbol systems, schools, and individual teachers participating in the ) 

Georgia NET program have a great deal of freedom in determining the content 

an* pacing of .NET at the classroom level. Given this planned diversity it was 

impossible ahead of time to ascertain the degree to which the evaluation's* 

Measurement bat*f§9 would be relevant to classroom activities^ Informaiion 

• supplied by teadhers on the relevance of the test battery lf(ts us proceed in 

the belief that the great majority of items in the test battery (over 90 

percent) are indeed relevant to the nutrition education activities occurring 

in NET classrooms. Information supplied by non-NET teachers suggests strongly* 

9 

that, nutrition education of some sort' is taking place in many comparison 
K classrooms (78 percent of the test battery was relevant to what comparison 

teachers were teaching) mnd that our evaluation of the Georgia NET program 
. involves a comparison of alternative nutrition education treatments. 



Nutrition Education Took Place Prior to" the Pretest 
-sMany NET teachers reported covering significant amounts of nutrition 

_ 4 



material prior to the prete* t— material relevant to 44 percent of the items in 
the test battery. Further, most non-NET teachers reported that the test bat- 
tery was relevan\jtb their classroom activities and it appears tlflft the 
"treatment" offered the comparison children in Georgia was almost as appropri- 
ate to the test battery as the treatment offered NET children. Therefore, 
this evaluation, is constrained in its ability to detect effects of the pro- 



gram—analyses may well underestimate the "true" treatment effects. IT 
ppeitive (or' negative)- effects are found they will have been produced under 
a handicap^ut we will h^ve some confidence that they exist. On the otAer 
'l^MOfw ' the interpr.tation of a finding of •no effects"" will be-nraoh more 
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ifficult. It will Be unclear whether no effects were fcwnd bec&fse 'the 
program was ineffective or becausjPthe effect was "missed" due to the weak 
evaluation design. This is,ribt a reflection on the program, but on the 
weakness of the evaluation as implemented. % " X • 

lap act of the Program m 

In spite of the dtfficulties rtoted above, the Georgia NET ^program had • 

♦ 

positive effects on children in some areas and mi^ed effects in others. Table 
3 presents a summary of" results by t content domain ^nd grade level. ^Table 4 
shows* results -at a less aggregated level. 



TabJLe 3 

Summary of lesults by Content Domain atfybcade Level 

. . .. ' • ■ / 

ContentV'Domain Grades 1-3 flfirades 4-6 Grades 7 , 8 



Nutrition Knowledge ■ Positive Ef fectsT MiW Positive ami Mj#ed Null . and 

■ , ^ ^ »Uj|rEffectts ™* Negative Effects 

Food Attitudes - \ Mixed Positive aad Minced Positive and NA 

Negative Effects Null Effects , 




Pood^abits " Mixed Positive, Mixed Null and NA , ^ 

Null , ( and NegaftJVe Negative Effects • * 

Effects y 

X — • * " ' ' • : : 
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Effects on Nutrition Knowledge Were Large /and Poeitiye 
in thejgarly Grades but Declined in the Late^ Grades "i/'' 

The patteri^of effects in the knowledge domain is characterized by, 
gains in NET and ' non-*NET^ groups Qn most measures. 5 Even Ibhough ^comparison 
. children excited gains,, they were outscored* bj^NEf children in the early 
grades ai^the evaluation found large positive effects in grades 1-4-, margin- 
ally positive or hull effects in the middle grades (S^nd^S)', and null . or 
V I. 
' • ^ #•.•••* / 

t ' * 
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Table 4 

Summary of Results from the Georgia ; Evaluation 
by Consent Domain, Measure , and Grade Level 




GRADE 



MEASURE 



. 1 



5. 6 



Nutrition Knowledge /(pair y Council 1) 
Nutrition Knowledge {(Deity Council 2) 
Nutrition Knowledge (Dairy Council 3) 
Nutrition Knowledge fNBAS/Intenm&iate) 
Nutrition Knowledge HfEAS/Intermediate) * 
Nutrition Knowledge (NBAS/ J r • High) 



0 0 

0 .0 

e k 



\ 

Food 

Attitude* 



Food Attitudes (AAI) * 
Food Consumption Attitudes (AAI)* 
School Lunch Attitudes (AAI) * 
Breakfast Attitudes (AAI)*> 



0 t 0 

0 0 0 
♦ #i o 



•Food* 
Habits 




4> 



•Good" Corwumption Habits (AAI) * 
•Bad" Consumption Habits (AAI) * 
School Lunch Habits (AAI) * 
"Good" Comjumption**bits (AAI) * 
"Bad" ConsSeption Habits (AAI)* 

■ Consumption Habits (WAS)* 
•Bad* Consumption Habits (NBAS) * 



0 



0 



0 
0 



0 
0 
0 
0 
0 



0 
0 
0 
0 
0 



based on scales d&eloped in the Nebraska study " 1 . » - 

signifies a statistically significant effect (p<.05) favoring the* treatment group 



signifies a statistically "significarft effect (p<. 10) favor in* the treatment group 
signifies 4 null or non-significant effect # * V 

signifies a statistically significant effect (p<. 0,5) favoring the control* group 



\ 



49 



negative . effects in junior high. Strong positive treatment effects are 
observed in grades. 1-4 on two different "standardized" t \^ts of general 
nutrition knowledge (the Dairy Council Achievement-.' test and the Nutrition 
Education Assessment Series)* In addition, the effects in these grades are 
large, ranging frpir .25 to 1 .27 - standard deviations, or about '1-5 test item*. « 
In grades 5 and 6 ho significant knowledge effects were observed, although 
some indication of positive differences exists as measured by a version of the 
NEAS which contained* a reduced number of items*. In grade 7 we see a signifi- 
cant * negative effect on the NEAS measure that is caused because the positive 
gain in the NET group is smaller than the positive gain of the non-NET control 



chlldrSfc. — No-positive or negative knbwledge effects are evident in grade 8. 
Effects on Food Attitudes Vary t?y Grade and Measure 

In the attitude domain we^&ee^a mixe$ pattern' of positive, negative, 
and null effects which vary by grade and measure. Large positive effects are 
found in grades 1 and 2 on a measure of food attitudes, and the negative 
effect in grade 3 reflects outstanding performance by the comparison children 
gather than a decline in attitudes of NET children. Scattered pyitive or 
marginall/ positive effects are noted in grades 4 and 5, and no "effects are 

evident in grade 6. * < 

* * , * * t 

r Blfecta on Reported Food Habits Vary by Grade and Measure 
For the foo^ habits domain we again seea^mix of positive, negative, 
and null Effects which, except for the large positive effects on one scale in- 
grades 1 and 2, are characterized by rather smal? effect sizes. 
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Conclusion* about the Georgia Eval^antion 

The results of "this evaluation' are in line with £hose of many other 
* evaluations' of in-school nutrition education programs'. we find, generally 
^ positive effects on nutfl^ion knowledge (at least in grades 1-4 and perhaps in 
grades 5 and 6) and -mixed effects on food attitudes and food- habits. The 

Georgia program appears to be more. effective with younger than older children, 

i 

since positive effects are observed in grades 1 and 2 on measures in all three 

■ . " '-^ 

domains. ' 

These findings' should be tampered by some taveats. Pirst./.as noted 
^earlier , this study is * quasi-experimental and the potential nonequi valence of 
NET and non-NET groups may bias the results. Second, the data preset££d 

earlier in this chapter suggest strongly that much nutrition education activ- 

? - 

* ity^ had already becurred in NET classrooms prior to the pretest, with the 

^ » r * 

. potential for attenuating any observed effects of the program,. Third, in many 
- cases the non-NET group gained from pre to po'sttest , * and comparison children 
may have been participating In nutrition education through sources other than 
rfBT. Data supplied by non-NET teachers support this hypothesis since they 
indicated that much Qf t the test battery was relevant to activities that they 
would 'be conducting in their classes. ^in^lly, the measurement battery was 

weak peychometrically, with many scales having low reliability./ Therefore, 

» t * • * 

positive .effects may be understated* - 

* * » 

, In addition to these carats,* the decentralized nature Of* the Georgia 

program is crucial to the interpretation ef the evaluation results. Georgia 

NET s^aff hold standardized training sessions foA sta&f in all participating 

schools; however, once the training is complete, school staf f *are responsible 

* — • 

for building their own programs based on input, received at'the training 0 , on 

existing resources and materials, and on any materials they might devise* 

> * ' -51 



Thus, it is quite liktfv 1 that the NET programs .implemented in the schools . 
participating in the peorgia evaluation- were qui te v different frcm one Another, 
The absence of in-depth documentation of those school-l^vel programs limits 
our ability to attribute program effects* The best evaluation for a state 

• T 

using a decentralized model would allow an analysis of program effects on a 
school-by-school basis • In this way the evaluation would be able to distin- # 
guish betweext differentially effective school-level programs. The most that 
can be said in the present case is that, in the early grades, the Georgia 
program demonstrates general ef fectivenessps^measures. of nutrition knowledge 
across a variety* of schools which tmay we^ l ^ b e Imp lementing different nutrition 
education activities. ;V 

Some corroborating evidence for the findings of this evaluatipn is 

C 

available frcm two sources. A' study by Emory University (1980) found pre/post 
kribyledge gains for children in Georgia 1 s NET program. While ' unable to stand 
^ on it!a own merits because of methodological problems, the Emory study does 
support the gains reported in the prrtent evaluation. A fctudy by Thielke, 
. Boyce, and Martinson (1981) claims that posttest differenced favoring treat- 
ment over control chif^ren In terms of total paloric intake, and nutrient 
consumption *ar* ^ue to participation of their teachers in the Georgia NET 
program training session. Because of > the weakness of this study (no pretest, 
nonequivalent groups) and the lack of corroborkting data from the present 
evaluation, we are hesitant K %o agree with its conclusions* 

Though it is surprising t,hat positive^ effects have been found given 
the' weakness of the evaluation as implemented (late pretest, existence of 
^ competing treatments, and unreliable measures), the binding of positive 
knowledge effects rjjinforces the conclusions of other evaluations: nutrition 
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education programs seeaF^tp be able to donHey knowledge consistency. The 
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mixed effects on measures of food attitudes ynd food habits also agree with 
findings from other studiejBr nitrition-^ication programs have not been able 
to consistently affect these measures. 1~" 1 

FINDINGS ^FROM OTHER NUTRITION EDUCATION EVALUAT IONS 

The findings* from our evaluations of NET in Nebraska and Georgia are ' 
important, and their value is enhanced by placing them in the larger context 
provided by other related evaluations. Our criteria fo.r selecting evaluations . 
to review in this sectior\were that .they be as strong as 'possible in terms of 
♦research deafign and measurement characteristics. Thus, the discussion draws' 
upon evaluations of nutrition education programs in California, Pennsylvania, 
, and We st- Virginia, as well as -a study conducted across five states, 

Evaluation of jthe California NET 
Curriculum Guide (Wolff 1980) r> 

Wolff (1980) conducted .an ^ evaluation of the California curriculum 
gui£e for nutrition education ia* presohpol through grade 6. The 'study in- • . 
volved non-randomly formed treatment *and comparison 'groups in 12 school dis- 
tricts and six prescrfools. ^ Over ^<500 children were pre and posttested in 
Fall 1979 and in Spring_L98TJ. with a measurement battery developed, to assess j 
knowledge, attitudes, and behavior (plate waste). • 

Across , all grades trwtment* children gained significantly more than 
comparison children in .frerms <gf nutrition knowledge. Significant treatment 
effects were* found: with^ each o? the grades 1-6 but not in preschool or 
kindergarten. In addition to being statistically signif icaid*'the gains also 
appear to be- reasonably larq£ in magnitude. Although precise inf6rmat ion, on • 
the variability of scores was not contained in the report, the overall treat- 
ment effect corresponds to a gain^of about one item or .25 standard devia- 



53 

; \ n . • 

ERIC . 



tions. The within-grade effects ranged from no items in preschool to' about 

two items in grade 6, the latter being about .5 standard deviations. * \ 

r 

The evaluation also fqund a positive treatment effect on attitudes J > 

across all grades. However , when broken down by grade we find statistically 
significant positive effects in preschool through grade 2, positlvi but 
nonsignificant effects in grades 3 and 4, and negative but nonsignificant 
effects in grades 5 and 6. It may be that attitudes are more difficult to , 
change in older children. 4 In general, while some of the Attitude gains are 
statistically significant they are not large in magnitude, though the inter- 
action renders the overall gain small in magnitude (1.9 percent gain or about 
.1 standard deviations) the gains in preschpol through grade 2 are somewhat > 

jaeger r <J$?ut four ^percent^ one item„(;25 standard deviations). . m i 

Finally, the evaluation found positive treatment effects on plate 
waste. Across all food groups plate waste was reduced by 25 percent in the 
treatment group compared wit^f a one percent reduction in> the comparison group. 

- Significant treatment *ef fects^were found for all food types except milk. Al- 
though there is no questioning the statistical significance of th$ effect, the % 
use of percentage change as a metric make$ the differences look quite large. 
Use of a different metric, Mt.<g. , change in grams, would teli the same story in 
terms of statistical significance, but leads to i conclusion th&t sounds very 
different — the to£al reduction in plate waste was 36.5 grams, or about 1.25 

' ounces "pe^child. In the absence of information on the total amount served it 
is difficult to make judgments about the practical significance fc of either a 25 

* 

percent or a 1.25 ounce ^eduction In plate was£e. What is clear, is that the 
metric influences our interpretation*^ the effect size. 

1 • * 
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Evaluation of the California NOT 
Program (Mecklet and Wilcox 198Cf) 

* § * 

.Heckler and Wilcox (1980) conducted a major evaluation of the Califor- 

nia NET program in 1979-80. The study involved over 1.3,000 children in J43 
schools that conducted a range of NET programs throughout California. ■ Non- 
randomly formed treatment and comparison groups were administered a pretest 
and posttest battery designed to .measure knowledge, attitudes, and pLate 
waste. The evaluators analyzed the data 9 rad f grade and found positive 
effects acro^s^grades pre-?K through 6 on student knowledge, overall positive 
effects on. plate waste (although there was a mix of positive, null, and nega- 
tive effects that vary^by .food type andgrade), and no effects on attitudes. c 
^he generally positive' picture for knowledge mudt be tempered in two 
areas. Pirst* though Statistically significant ^ffects favoring -the treatment 
gupoup were found- in every gride f roo- preschool to grade 6> the report gives na 
assessment ^of the magnitude of the effects. The knowledge test included 15 
items for preschool and grade K, and 22 items for grades 1-6. Adjusted treat- 
ment/comparison group posttest differences ranged from .3 items in grade 2 to 
3.7 items in grade 3 with an overall mean of 1.6 items. Clearly, .the differ- 
ence of .3 items is small and the difference of 3.7 items is large, but in tine 
absence of information on the variability of test scores it is difficult to 
draw' conclusions as to the practical significance of the knowledge effects. 

Evaluation \ot "Nutrition in a Changing World" , • 
* ' Conducted in Pennsylvania by Shannon et al. (1981) * 

Shannon et al. (1981) conducted a study of the impact of "Nutrition in 

a* Changing World," a comprehensive integrated nutrition education curriculum 

for grades K-6. This curriculum is one of several recommended hot use by 

Pennsylvania NBT-of f icials and is being infclemented in many local N§T projects 

in that state. 
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The evaluation compared ttrM levels of treatment — use of the Curricu- - 
Ion guide plus a 45*hour nutrition education course for the classroom teacher, 
use of the curriculum guide plus a three-hour in-service training courfe for 
the teacher, and use of the curriculum guide with no extra training for the 
\ t*acher— and no nutrition education (a control group) . Twenty-nine schools 
, were randomly assigned to one of the . treatment groups. The final sample 
included 156 classrooms and 2,959 children -in grades K, 1, 4, 5, and 6. All 
children were pretested with a battery of curriculum-specific knowledge 
measures and posttested ten weeks later. 

» u 

Collapsing across' the three different levels of treatment the evalua- 
•tors *ound positive effects of instruction (i.e. , ^presentation of the nutri- 
tion curriculum regardless of type of teacher training) on nutrition knowledge 
at ^1 grade tlevels. The magnitude of the effects ranged from about one »i tern 
in grades Land T to three items in grades 4 and 6. Statistically significant 

effects of different types of teacher preparation were found but they varied , 

* • 

by grade and type of preparation. Kindergarten children taught by teachers* 
having the three-hour in-service, training did better than the other two groups • 
(by less than one item); in grade 4 .children of teachers who had the 45-hour 
course did better than the other two groups (by about three items) ; and in 
grade 6' the three-hour in-service group outscored the 45-hour training group, 
(by about "two and one-half items)". No effects of different forms of teacher n 



preparation were found # in grades 1 and 5. ♦ 

To lis up, the evaluation found positive effects of the nutr ition'edu- 
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cation" curriculum on nutritifn fcno^ledge, 'the only outcome investigated. How- 
ever, an interesting study of the effects of different types of teacher prepa- 

ration found that "the provision of an 'in-service or formal cpurse as addi-r 
* «* * 
V \ 
tional 1 teacher preparation did. not psomote consistent improvement in student 

outcome, particularly wfcth the younger grades. " 
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West Virginia Nutrition Education Evaluation 
(West Virginia Department of Education 1977) n 

This project included the development , implementation, and .evaluation 
of a 'nutrition ^Mucation curriculum guide for grades K-£ in West Virginia, 
Though the evaluation was conducted prior to the initiation of NET in 1977, it " 
was funded by PNS. Over 200 school sj ire r** randomly assigned to treatment and 
contfol status, but many elected not to 'participate and the study was con- 

i 9 

ducted using '44 experimental and 42 control schools, The^ study design is 
notable in that it controlled for the possible effects of learning from the 
pretest.. ' 4 

The treatment schools sent- teachers to a two-day in-service program 
and implemented the nutrition education curriculum in grades # K-6 over a three- 
month time period. * Over 23,000 treatment and control children were pre and 
, posttested with a battery of measures including knowledge tests and attitude 

inventories. Plate w^te and school lunch participation were also measured. 

* • 

The evaluators found positive program effects on nutrition-related 
% knowledge in grades K-3, 5, and 6. Though control group children Showed pre/ 

post gains in al]> grades they were outperformed by the treatment children in . 
al^ except the fourth grade. while this finding corroborates those 'of most 
< ^ otiier nutrition education evaluations, the present study also^ found positive 
treatment effects on food-related attitudes in all grades except kindergarten. 
/ Again, -control group attitudes improved in most grades, but treatment group 
A attitudes improved significantly more. 

~ A plate waste study also found positive effects in which treatment 
' _ t children exhibited a reduction in plaste waste from pre to .post test that was 
significantly greater than the reduction, for control children on* five out of 
seven measured foods. Plate waste was reduced for broccoli from i63 .to S6 • * 
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percent, for tadps from 41 to 24 percent, for milk from 17 to 13 percent, for 
cauliflower froa 55 to 36 perbentr and for Spanish rice from 44 to 36 percent. 
Plate vaste was reduced for the other, two foods , but not significantly. As 
was the case in the Wolff (1980) evaluation of the California NET curriculum 
guide, it is difficult to make informed* judgments about the practical signi- 
ficance of these plate waste findings without information on' the total amount 

f 

served. Finally, the evaluation found no evidence of an impact on school 
lunch' part icipatiOn; not sur pr ising in light of thi^short pre/post test 
Period. - - 

Thus evaluation presents some of the most impressive results reviewed 

/ J 

in this study. Strong positive effects w^re reported on nutrition-related 

^ 1 
knowledge, fpdd attitudes, and plate waste. While the evaluation- design is. 

characterized by self-selection of schools, the -results do conform to the 

program developers' hypotheses. . ^ 

Evaluation of "Food is My Bag" 
(Applied Management Sciences 1976) 

This project involved the development, implementation, and evaluation 
of a nutrition education sprogr am in five states by Applied Management Sciences 
(AMS) . Though this s'tudy was conducted prior to initiation of the NET pro- 
gr am, it was funded by FNS». ^ 

From the five states selected by FNS, AMS chose one school district in 
each based on geographic location and socioeconomic status. Six schools were 
then selected within each district, two from each' of three grade ranges (ele- 
mentary, junior high, senior high) ,^t^d two classes were selected from' each 
grade level in each school. AMS developed^^nftatri tion education program pack- 



age for the selected school districts and worked with the local school person- 
nel in implementing the program. > The cur riculum ^package contained 15 units 
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of instruction— three curriculum uniS^N (Basic Nutrition, Consumer Education, 
and Health Education) for each of five selected grade ranges (K-1 , 2-3,- 4-6> 
7-9, 10-12) . A companion booklet of related activities was also developed for 
use bv the school food service manager. * 

During the field test period of approximately three months*, knowledge 
tests and attitudinfel questionnaires were administered tp control and experi- 
^mental subjects as a pretest, posttest, and' 30-dfcy follow-up posttest. Plate 
waste observations" were also conducted "byfc project staff at each control and 
-experimental s^te during the three test .periodsJ Based on the evaluation the 
^ AMS researchers d^w the following conclusions: 1 

• Significant statistical gains' in nutrition knowledge took 
place among experimental students for the Basic, Health, 
and Consumer Units at %11 grade levels. No sinvilar gains 
were noted for the control students. 

j • Tn^je was no overall significant positive or negative 

effect on students 1 practices and attitudes toward food 
\ 1 at school .and away from school. There we£e positive * 

' changes in ,Cft£tain individual Attitudinal scale items and 

at certain grade levels. The greatest amount of positive 

change was noted for grade spans K-1 and 2-3. 

* 

• Plate waste observations demonstrated modest improvement 
. in consumption of the school lunch by experimental stu- 

'dents witlf^signif icantly increased consumption of meat, « • . 
milk, bread, and "other" foods (e.g., dessert, potato 
chips, etc.) for most grade levels. 



CONCLUSIONS ABOUT THE IMPACTS OF NUTRITION EDUCATION 
y Each of the evaluations, discussed here has its weaknesses ; how- 

ever, as a group the studies yield some fairly convincing evidence on the 
effects of nutrition education. Table 5 summarizes results Irom the evalua- 
tions discussed in this chapter by noting the mafor findings on each of 
several outcomes. First, it appears relatively easy to produce positive 
effects on nutrition knowledge .^ All eight studies report positive findings 
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ATTITUDCS 



Poaltlva af facta 1a gradaa 
1-4. Ho af facta la pra- 
achool aad kladargartaa . 
Magaitada of poaltlva 
af facta raagaa froa .23 - 
5* standard deviations. 



Poaltlva af facta la gradaa 
Maguitudn of af f act 
froa .3 to 9.7 itaaa. 



Poaltlva af facta la pra- 
ac boo 1 tkroogh grada 2. 
Mo af facta la gradaa >-4. 
Magnltoda of af facta La 
small, froa . 10 - .25 
atandafd davlatloaa. 



Posit iva af facta oa aavaral 
asasuxss la aradaa 1-4. Mag- 
altada of off acta raagaa froa 
• 2S-.t* ataadard davlstfoaa. 



Poaltlva af facta 4a gradaa 
1-3 oa two of foar asaauraa. 
la aradaa 4-4 oa foar af kla 



■o af facta. 



faata. 



Mo af facta. 



Poaltlva af facta oa ra- 
portad food praf araaca a 
trllllagnaaa to aalact a* 
fooda la aradaa 1-3. 
af facta oa raportad food 
prafaraoca la aradaa 4-4 

Mo af facta. 



Poaltlva affacta oa ovarall 
conaoMptloa. Kf facta for ' 
all food typaa ascapt allk. 
Trait — t group raducad 
plata wast a by 25 parcaat 
( about 1«2S ouacaa) coa 
par ad with 00a parcaat la 
tha ooaparlaoa group. 

Poaltlva affacta 00 aaat* 
vugatablaa, fruit, Endue- 
tloa la plata waata varlad 
by food a Mr n aad grada . 
Hbaa algaiflcaat, r ad ac- 
tions- rangad froa a- 16 
parcaat ovar ooaparlaoa 
group raductloa. 



Mo affacta oa total coo a 
aaaptloa. Poaltlva affacta 
' in, aradaa 4-4 la t a rata of 
vllllognaaa to taata pra- 
vloualy rajactad fc^>da. 



Poaltlva affacta oa aavaral 
■aaauraa la aradaa 1*4, da- 
c 11a lag la la tar gradaa. 
Magaitada of affacta raogaa 
froa .25-1.37 at 
wUtl 

a 

Poaltlva affacta la gradaa 
C-4. Magnitudn of affacta • 

Mo ooaalataat af fact of dif- 
faraut forma of taacbaf 
praparatloa. 



Mlxad affacta aaroaa aav- 
aral aaaaaraa aad gradaa 
1-4. Poaltlva affacta 
la gradaa 1-2, parbapa 



grsdas 4-$. 



Mlxad affacta acroaa 
•sn-ajal aaaauraa 
aad gradaa 1-4. sons 
poaltlva affacta la 
gradaa 1-2. 



Poaltlva affacta la gradaa 

*-3, S-4. 



Poaltlva affacta la gradaa 
It- 12. •*» 



Poaltlva affacta la gradaa 
T*a, act la klfc/largarta*. 



• Mo ovarall affacta. <oaa 
poaltlva ohaaga aotad la 



algaiflcaat raductloa for 
flva of savaa fooda atudlad. 
Waata raducad froa 4-19 
parcaat for individual 



Mo affacta. 
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Poaltlva affacta oa aaat, 
allk, braad at aoat grada. - 
lavala. Mo ovarall af fact. 



m group la 
aava fouad 



thl* atady. 



Paau; 



Ita abaald ba roaaxdad uttk oawtloa baoauaa otadr atudlaa 



ooaparlaoa groups aaasrally axnlalt pr a/post tokouladgu galaa. 
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on knowledge , findings that are not only statistically significant, but are 
large size (.25*1.27 standard deviations) for social science evaluations. The 
fact that in most of the stud ier comparison students also showed pretest/post- 
test gains suggests that normal maturation, a competing treatment, or spme 
other factor is responsible for gains , in nutrition knowledge $ven in the 
absence of NET programs. It may be that children have not had a great amount 
of exposure to nutrition concepts, and that learning these concepts is fun and 
relatively easy. 

Effects on food attitudes and reported food habits are much more dif- 
ficult to produce. Pour studies reported some p^itiv^ effects on attitudes ; 
however , -with the exception of the West Virginia study these varied by measure 
and grade. The California and Georgia studies did find positive attitude 
effects in grades 1 and 2 suggesting that it may be easier to alter attitudes 

*- ^ 

for children in' the early grades. Four of the studies included an examination 
of reported . good habits , but none found any strong evidence of program effec- 
tiveness in this area. 

Evidence on food pr-eference was supplied In only two studies. Conclu- 
sions are mixed because one study (St. Pierre et al. 1981) found a strong 
indication of positive effects on reported food preference' and willingness tg 
select new foods while the other (Ma jure 1980) found no effects. 

The' summary picture is therefore x>ne in which positive effects on 
knowledge appear to be almost universal while effects on attitudes, food 
preference, plate waste, and other behavioral measures are scattered^ and 
cfonfined to specific grade" and food item combinations. These findings "make 
a^ood deal of sense considering the short-term nature of the. programs. 
Knowledge is easily conveyed in the short-term; to expect a three«-week program 
to significantly impact behaviors that have been formed for several years /is 
quite different. , & 
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CHAPTER 5 
CONCXUSldllS 



This evaluation^— was, conducted when most NET projects were just 




beginning to be implemented, and NET 'has made a gbpd start. Programs are -J 
Operating in mo^t states and WET funds are being distributed an&Hited as 
intended. Sexy 86 'percent of aI>WET funding in 1978 and 1979 wafe spent on 
grants for almost 3,000' local' projects operating. in pearly 17,000* schools and 
reaching, more 'than 3.4 million children/ Over 120 ,000 teachers and 75,000 

* ^foad service personnel* participated in NET-sponsored workshops. 

K jjrt of div^e^^stat^levrl* NET programs 'have been developed and ' 
implemented . Some^e c%<r41iz^d and administered at the state level, in- 
volving all participatiq?projec£s via a single curriculum. Others arte 
decentralized and, sifcject ttf tJroad guidelines, transfer 'the responsibility of 

< program development to the local level. Stil\ others are regionally-based, 
o with services being provided by multiple resource centers, ' £lassroom instruc- » 



tion is included in J*^ percent of all projects, 60 percent use t$e cafe- 
teria as a learning laboratory. 

> Oft 

The great majority o^NET State Coordinators cand -project directors fie- ' 
port that they are striving toward the goals intended by the enabling legisla- ' 
tion including , for example , incra#s ing children 1 s acceptance of nutr i tious 
foods; improving teachers* knowledge .of the principles and^pr actices of nutri c 
tion, efluca&ioni developing ,and. disjointing curricula and other .nutrition y 
education materials; increasing children 1 A knowledge of the relationships 
among food, nutrition, and health; % and increasing the use of the school 
cafeteria as a learning laboratory for nutrition education. ^ 

A welt-designed evaluation of Nebraska's state- level prbgram showed 
that a curriculum-oriented, centrally-administered nutrition education pro- 

' r 4 * 

gram can have positive effects on children's nutrition-related knowledge 



? 
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across grades 1-6^ and posi;tive effect's in selected grades on food preference 

and willingness to select and taste new foods * Evaluations of oth^r Nutrition 

education . programs funded by NET and other FNS sources (e.g., California, 

Georgia* *Pennsy0ranIa, m West Virginia) # demonstrate that decentralized 'programs . 

can also have positive effects in terms of increased nutrition knowledge. 

' r 

^osi£ive 'effects on food-related attitudes, habits, preferences, and plate ^ 
waste were found in certain evaluations, but they vary by grade. * 

^ Of course , room for improvement exists. Although most of the objec- 
tives of the NET legislation are addressed by the operating programs, there 
were three areas where, in 1979, NET activities did not appear to' be as fully 
implemented or as successful as desirable *' including the training jo£ school 
food service personnel, thte development of integrated programs^^nd the 
development of program monitori^ and evaluation materiais. • These topics 
shcyald be emphasized in the future, perhaps through altered program regula- 
tions making expectations in these areas clearer, through the dissemination of ~\ 
information 3h programs that have been successful in these areas/ and through z 0 ^^^^ 
the provision of technical assistance in evaluation. /*"*" > ^ 




NET projects were in their formative statBerwhen this evaluation 
waj^conducted. Project development undertaken since' 1979 may well 
have addressed these problems. ^ 
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